GRANT  NUMBER:  DAMD17-94- J-4072 


AD 


TITLE:  Special  Sabbatical  for  Training  in  Health  Decision 

Sciences  with  Application  to  Breast  Cancer  Treatment  Evaluation 


PRINCIPAL  INVESTIGATOR:  Richard  D.  Gelber  ,  Ph.D. 


CONTRACTING  ORGANIZATION:  Dana-Farber  Cancer  Institute 

Boston,  MA  02115 


REPORT  DATE:  Feb  96 

TYPE  OF  REPORT:  Final 


PREPARED  FOR :  Commander 

U.S.  Army  Medical  Research  and  Materiel  Command 
Fort  Detrick,  Frederick,  Maryland  21702-5012 

DISTRIBUTION  STATEMENT:  Approved  for  public  release; 

distribution  unlimited 


The  views,  opinions  and/or  findings  contained  in  this  report  are 
those  of  the  author (s)  and  should  not  be  construed  as  an  official 
Department  of  the  Army  position,  policy  or  decision  unless  so 
designated  by  other  documentation. 


■DT£G  QUALETT  IK 


EFEQTj&D 


19960405  045 


Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  Instructions,  searching  existing  data  sources, 
gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this 
collection  of  information,  including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson 
Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302,  and  to  the  Office  of  Management  and  Budget,  Paperwork  Reduction  Project  (0704-0188),  Washington,  DC  20503. 

t.  AGENCY  USE  ONLY  (Leave  blank)  2.  REPORT  DATE  3.  REPORT  TYPE  AND  DATES  COVERED 

Feb  96  Final  (1  Feb  95  -  31  Jan  96) 

4.  TITLE  AND  SUBTITLE 

Special  Sabbatical  for  Training  in  Health 
Decision  Sciences  with  Application  to  Breast 
Cancer  Treatment  Evaluation 

5.  FUND 

DAM 

ING  NUMBERS 

ID17-94-J-4072 

6.  AUTHORfS) 

Richard  D.  Gelber*  Ph.D. 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Dana-Farber  Cancer  Institute 

Boston,  MA  02115 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

9.  SPONSORING  /MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

Commander 

U.S.  Army  Medical  Research  and  Materiel  Command, 
Fort  Detrick,  Frederick,  MD  21702-5012 

10.  SPONSORING /MONITORING 

AGENCY  REPORT  NUMBER 

11.  SUPPLEMENTARY  NOTES 

12a.  DISTRIBUTION /AVAILABILITY  STATEMENT 

Approved  for  public  release; 
distribution  unlimited 

12b.  DISTRIBUTION  CODE 

13.  ABSTRACT  (Maximum  200  words)  .  .  ,,  , 

A  special  sabbatical  year  enabled  Dr.  Richard  D.  Gelber,  Ph.D.,  an  internationally  respected 
clinical  trial  biostatistician,  to  receive  training  in  contemporary  methods  and  applications  of  health 
decision  sciences.  Dr.  Gelber  has  been  the  Director  of  the  Statistical  and  Data  Management  Center  for 
the  International  Breast  Cancer  Study  Group  (IBCSG:  formerly  Ludwig  Group)  since  1978.  With  Dr. 
Aron  Goldhirsch,  IBCSG  Scientific  Director,  he  developed  the  Q-TWiST  method  (Quality-adjusted 
Time  Without  Symptoms  of  disease  and  Toxicity  of  treatment)  for  integrating  aspects  of  quality  of  life 
into  an  evaluation  of  adjuvant  therapies  for  operable  breast  cancer.  Dr.  Gelber  also  participates  in  the 
Worldwide  Overview  of  randomized  clinical  trials  evaluating  adjuvant  therapies  for  breast  cancer.  In 
addition,  he  currently  coordinates  biostatistics  for  the  Division  of  Pediatrics  at  Dana-Farber  Cancer 
Institute,  directs  the  Pediatric  Section  of  the  Statistics  and  Data  Analysis  Center  for  the  NIH  AIDS 
Clinical  Trials  Group,  and  teaches  a  course  in  clinical  trials  at  the  Harvard  School  of  Public  Health. 

This  award  freed  Dr.  Gelber  from  his  non-breast  cancer  related  research  responsibilities  for  one 
year,  and  enabled  him  to  study  methods  in  health  decision  sciences  under  the  mentorship  of  Professor 
Milton  Weinstein.  This  significantly  enhanced  Dr.  Gelber's  ability  to  influence  treatment  choices  for 
patients  with  breast  cancer  by  refining  interpretation  of  clinical  trial  results.  The  special  sabbatical 
coincided  with  the  third  update  of  the  Worldwide  Overview  in  which  Dr.  Gelber  participated. 

14.  SUBJECT  TERMS 

health  decision  sciences,  breast  cancer  adjuvant  treatments, 
cost-effectiveness  analysis,  cost-benefit  analysis, 
quality-adjusted  survival  analysis  >  breast  cancer 

15.  NUMBER  OF  PAGES 

■  j  73 

16.  PRICE  CODE 

17.  SECURITY  CLASSIFICATION  18.  SECURITY  CLASSIFICATION  19.  SECURITY  CLASSIFICATION 

OF  REPORT  OF  THIS  PAGE  OF  ABSTRACT 

Unclassified  Unclassified  Unclassified 

20.  LIMITATION  OF  ABSTRACT 

Unlimited 

NSN  7540-01-280-5500  Standard  Form  298  (Rev.  2-89) 


Prescribed  by  ANSI  Std.  Z39-18 


298-102 


GENERAL  INSTRUCTIONS  FOR  COMPLETING  SF  298 


The  Report  Documentation  Page  (RDP)  is  used  in  announcing  and  cataloging  reports.  It  is  important 
that  this  information  be  consistent  with  the  rest  of  the  report,  particularly  the  cover  and  title  page. 
Instructions  for  filling  in  each  block  of  the  form  follow.  It  is  important  to  stay  within  the  lines  to  meet 
optical  scanning  requirements. 


Block  1.  Agency  Use  Only (Leayeb/ank). 


Block  2.  Report  Date.  Full  publication  date 
including  day,  month,  and  year,  if  available  (e.g.  1 
Jan  88).  Must  cite  at  least  the  year. 

Block  3.  Type  of  Report  and  Dates  Covered. 


State  whether  report  is  interim,  final,  etc.  If 
applicable,  enter  inclusive  report  dates  (e.g.  10 
Jun87-30Jun88). 

Block  4.  Title  and  Subtitle.  A  title  is  taken  from 


the  part  of  the  report  that  provides  the  most 
meaningful  and  complete  information.  When  a 
report  is  prepared  in  more  than  one  volume, 
repeat  the  primary  title,  add  volume  number,  and 
include  subtitle  for  the  specific  volume.  On 
classified  documents  enter  the  title  classification 
in  parentheses. 

Block  5.  Funding  Numbers.  To  include  contract 


and  grant  numbers;  may  include  program 
element  number(s),  project  number(s),  task 
number(s),  and  work  unit  number(s).  Use  the 
following  labels: 


Contract 

PR  - 

Project 

Grant 

TA  - 

Task 

Program 

WU  - 

Work  Unit 

Element 

Accession  No. 

Block  6.  Author(s).  Name(s)  of  person(s) 
responsible  for  writing  the  report,  performing 
the  research,  or  credited  with  the  content  of  the 
report.  If  editor  or  compiler,  this  should  follow 
the  name(s). 

Block?.  Performing  Organization  Name(s)  and 


Address(es).  Self-explanatory. 

Block  8.  Performing  Organization  Report 


Number.  Enter  the  unigue  alphanumeric  report 
number(s)  assigned  by  the  organization 
performing  the  report. 


mflETIiTTOI 


Block  9.  Sponsorin 


and  Address(es).  Self-explanatory. 

Block  10.  Soonsorino/Monitoring  Agenc 


Report  Number.  (If  known) 

Block  11.  Supplementary  Notes.  Enter 


information  not  included  elsewhere  such  as: 
Prepared  in  cooperation  with...;  Trans,  of...;  To  be 
published  in....  When  a  report  is  revised,  include 
a  statement  whether  the  new  report  supersedes 
or  supplements  the  older  report. 


Block  12a.  Pistri bution/Availabi I itv  Statement. 


Denotes  public  availability  or  limitations.  Cite  any 
availability  to  the  public..  Enter  additional 
limitations  or  special  markings  in  all  capitals  (e.g. 
NOFORN,  REL,  ITAR). 


See  DoDD  5230.24,  "Distribution 
Statements  on  Technical 
Documents." 

See  authorities. 

See  Handbook  NHB  2200.2. 

Leave  blank. 


DOE  - 
NASA- 
NTIS  - 


Block  12b.  Distribution  Code. 


NASA- 
NTIS  - 


Leave  blank. 

Enter  DOE  distribution  categories 
from  the  Standard  Distribution  for 
Unclassified  Scientific  and  Technical 
Reports. 

Leave  blank. 

Leave  blank. 


Block  13.  Abstract.  Include  a  brief  (Maximum 
200  words)  factual  summary  of  the  most 
significant  information  contained  in  the  report. 

Block  14.  Subject  Terms.  Keywords  or  phrases 
identifying  major  subjects  in  the  report. 

Block  15.  Number  of  Pages.  Enter  the  total 


number  of  pages. 

Block  16.  Price  Code.  Enter  appropriate  price 
code  (NTIS  only). 

Blocks  17.  - 19.  Security  Classifications.  Self- 


explanatory.  Enter  U.S.  Security  Classification  in 
accordance  with  U.S.  Security  Regulations  (i.e., 
UNCLASSIFIED).  If  form  contains  classified 
information,  stamp  classification  on  the  top  and 
bottom  of  the  page. 

Block  20.  Limitation  of  Abstract.  This  block  must 


be  completed  to  assign  a  limitation  to  the 
abstract.  Enter  either  UL  (unlimited)  or  SAR(same 
as  report).  An  entry  in  this  block  is  necessary  if 
the  abstract  is  to  be  limited.  If  blank,  the  abstract 
is  assumed  to  be  unlimited. 


Standard  Form  298  Back  (Rev.  2-89) 

*U.S.GPO:1 993-0-358-779 


THIS  DOCUMENT  IS  BEST 
QUALITY  AVAILABLE.  THE 
COPY  FURNISHED  TO  DTIC 
CONTAINED  A  SIGNIFICANT 
NUMBER  OF  PAGES  WHICH  DO 
NOT  REPRODUCE  LEGIBLY. 


FOREWORD 


Opinions ,  interpretations,  conclusions  and  recommendations  are 
those  of  the  author  and  are  not  necessarily  endorsed  by  the  US 
Army. 

N/4  Where  copyrighted  material  is  quoted,  permission  has  been 
obtained  to  use  such  material. 

DM  Where  material  from  documents  designated  for  limited 
distribution  is  quoted,  permission  has  been  obtained  to  use  the 
material. 

V]k_  Citations  of  commercial  organizations  and  trade  names  in 
this  report  do  not  constitute  an  official  Department  of  Army 
endorsement  or  approval  of  the  products  or  services  of  these 
organizations  . 

In  conducting  research  using  animals,  the  investigator (s) 
adhered  to  thp>  "Guide  for  the  Care  and  Use  of  Laboratory 
Animals,”  prepared  by  the  Committee  on  Care  and  Use  of  Laboratory 
Animals  of  the  Institute  of  Laboratory  Resources,  National 
ppc-parrh  Council  (NIH  Publication  No.  86—23,  Revised  1985). 

*H i  For  the  protection  of  human  subjects,  the  investigator (s) 

adhered  to  policies  of  applicable  Federal  Law  45  CFR  46. 

VJh  in  conducting  research  utilizing  recombinant  DNA  technology, 
the  investigator  { s )  adhered  to  current  guidelines  promulgated  by 
the  National  Institutes  of  Health. 

in  the  conduct  of  research  utilizing  recombinant  DNA,  the 
investigator  (s)  adhered  to  the  NIH  Guidelines  for  Research 
Involving  Recombinant  DNA  Molecules. 

In  the  conduct  of  research  involving  hazardous  organisms, 
the  investigator (s)  adhered  to  the  CDC— NIH  Guide  for  Biosafety  in 
Microbiological  and  Biomedical  Laboratories.  •  •  •  ^ 


><W  D.Jkviku  2/£z/% 


PI  -  Signature 


Date 


Gelber,  Richard  D. 


FINAL  PROGRESS  REPORT 

Special  Sabbatical  for  Training  in  Health  Decision  Sciences 
with  Application  to  Breast  Cancer  Treatment  Evaluation 


PAGE 


TABLE  OF  CONTENTS  4 

INTRODUCTION  -  Background,  Relevance,  and  Methods  5 

BODY  -  Progress  Report  on  Specific  Aims  8 

CONCLUSIONS  14 

REFERENCES  15 

APPENDIX  (items  copied  on  both  sides  of  the  page)  16 


-  Paper  Presented  at  the  EORTC  Symposium  on  Methodological  and 
Statistical  Issues  of  Quality  of  Life  and  Economic  Evaluation  in 
Cancer  Clinical  Trials. 

-  Grant  prepared  to  support  the  development  of  breast  cancer  patient 
preferences  for  use  in  Q-TWiST  analyses. 

-  Paper  published  in  The  Cancer  Journal  of  Scientific  American  on 
the  Q-TWiST  meta-analysis  evaluating  chemotherapy  for 
premenopausal  breast  cancer  patients. 

-  Paper  in  press  in  The  Lancet  on  the  Q-TWiST  meta- analysis 
evaluating  chemotherapy  plus  tamoxifen  versus  tamoxifen  alone 
for  postmenopausal  breast  cancer  patients. 


Final  Progress  Report  Page  4 


Gelber,  Richard  D. 


FINAL  PROGRESS  REPORT 

Special  Sabbatical  for  Training  in  Health  Decision  Sciences 
with  Application  to  Breast  Cancer  Treatment  Evaluation 


INTRODUCTION 

A  crucial  question  both  for  the  individual  breast  cancer  patient  and  for  society  as  a  whole 
is  identifying  "optimal"  treatment  strategies  for  the  medical  care  of  each  woman. 
Randomized  clinical  trials  are  now  well-established  as  the  gold  standard  methodology  for 
comparative  assessments  of  treatments  for  breast  cancer.  As  Director  of  the  Statistical 
Center  for  the  International  Breast  Cancer  Study  Group  (IBCSG:  formerly  Ludwig 
Group),  Dr.  Gelber  has  contributed  substantially  to  the  design,  conduct,  analysis  and 
interpretation  of  randomized  clinical  trials  for  breast  cancer  adjuvant  therapies. 

The  usual  statistical  approaches  to  the  evaluation  of  such  studies  (e.g.  assessment  of 
disease-free  survival  and  overall  survival),  however,  do  not  adequately  reflect  the  impact 
of  therapies  on  the  health-related  quality  of  life  of  the  patients.  Dr.  Gelber,  in 
collaboration  with  Dr.  Aron  Goldhirsch,  developed  the  Q-TWiST  method  (Quality- 
adjusted  Time  Without  Symptoms  of  disease  and  Toxicity  of  treatment)  to  perform 
breast  cancer  adjuvant  therapy  treatment  comparisons  based  on  quality-adjusted  survival 
analysis.  The  method  has  been  applied  in  several  clinical  trials  to  illustrate  the  trade-off 
between  quality-of-life  decrements  related  to  toxic  effects  of  treatment  and  quality-of-life 
benefits  associated  with  prolonging  the  time  to  breast  cancer  recurrence.  Although  the 
method  is  technically  similar  to  the  health  decision  science  QALY  approach  (quality- 
adjusted  life  years),  Q-TWiST  was  developed  within  the  context  of  randomized  clinical 
trials.  Thus,  Q-TWiST  begins  to  bridge  the  gap  between  clinical  trials  research  (used  by 
medical  oncologists)  and  clinical  decision  research  (used  by  decision  analysts). 

Decision  analysis  is  a  systematic  approach  to  decision-making  under  conditions  of 
uncertainty.  By  learning  more  about  contemporary  methods  and  applications  of  health 
decision  sciences,  such  as  decision  tree  design,  sensitivity  analysis,  Markov  processes, 
cost-effectiveness  analysis,  utility  assessment,  and  multi-attribute  utility  theory,  Dr. 
Gelber  took  the  next  step  to  build  on  the  Q-TWiST  method  and  clinical  trial  applications. 
Dr.  Gelber's  new  training  enabled  him  -  when  designing  clinical  trials  -  to  consider 
factors  that  influence  subsequent  clinical  decisions.  This  special  sabbatical  was, 
therefore,  directly  relevant  to  improving  methods  used  to  evaluate  treatments  for  women 
with  breast  cancer.  The  additional  training  enhanced  Dr.  Gelber's  ability  to  contribute 
new  ideas  for  the  interpretation  of  results  from  the  Worldwide  Overview  of  adjuvant 
therapies  for  breast  cancer.  The  Third  Update  of  the  Overview  took  place  in  September, 
1995.  The  application  of  health  decision  sciences  methods  for  performing  supplemental 
analyses  on  this  enormous  database  will  provide  important  insights  concerning  costs  and 
benefits  of  treatments  for  women  with  breast  cancer. 
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The  Candidate  -  Dr.  Richard  D.  Gelber 

Since  acquiring  his  Ph.D.  in  1975,  Dr.  Richard  D.  Gelber  has  been  involved  in  a  variety 
of  activities  which  have  secured  his  international  reputation  as  a  top  biostatistical 
collaborator  in  clinical  trial  research.  His  career  reflects  his  commitment  to  the 
application  of  appropriate  statistical  methods  for  the  design  and  analysis  of  cancer 
clinical  trials  through  successful  collaboration  with  medical  researchers.  His  leadership 
in  international  breast  cancer  trials,  his  innovative  research  in  quality-of-life  methods,  his 
outstanding  contributions  to  the  pediatric  oncology  program  at  the  Dana-Farber  Cancer 
Institute  (DFCI),  and  his  service  to  the  Department  of  Biostatistics,  Harvard  School  of 
Public  Health  (HSPH)  illustrate  the  quality  of  his  work. 

Dr.  Gelber's  main  research  interests  involve  the  practice  of  biostatistics  for  the  design, 
conduct,  analysis  and  report  of  clinical  trials  in  breast  cancer,  pediatric  oncology  and 
pediatric  AIDS.  A  significant  contribution  has  been  the  development,  with  Dr.  Aron 
Goldhirsch,  of  the  TWiST  and  Q-TWiST  methods  for  comparing  treatments 
incorporating  aspects  of  quality  of  life.  TWiST,  which  stands  for  Time  Without 
Symptoms  of  disease  and  Toxic  effects  of  treatments,  was  originally  proposed  to 
compare  adjuvant  chemotherapy  versus  observation  for  postmenopausal  women  with 
operable  breast  cancer.  The  overall  survival  time  for  patients  in  clinical  trials  is 
partitioned  so  that  the  positive  effects  of  treatments  which  prolong  the  time  to  disease 
progression  can  be  balanced  against  the  increased  subjective  toxic  effects  of  such 
therapies.  This  work  received  the  1987  Robert  Wenner  Prize  awarded  by  the  Swiss 
Cancer  League,  and  the  1987  Farmitalia  Carlo  Erba  Prize  awarded  by  the  German  Cancer 
Society's  Working  Group  for  Medical  Oncology. 


O-TWiST 

Quality-adjusted  TWiST  (Q-TWiST)  represents  a  generalization  of  the  method  which 
allows  a  spectrum  of  utility  coefficient  weights  based  on  quality-of-life  considerations  to 
influence  the  interpretation  of  treatment  comparisons  in  clinical  trials.  (See  the  first 
paper  in  the  Appendix  for  a  description  of  the  method.)  Recent  work  supported  by  a 
research  grant  from  the  American  Cancer  Society  (awarded  1990-1994  with  renewal 
pending)  has  extended  the  application  of  the  method  to  a  variety  of  clinical  trial  settings, 
and  has  developed  further  alternative  methods  for  describing  treatment  benefit.  These 
have  focused  on  describing  treatment  effects  in  terms  of  the  amount  of  quality  time 
gained  by  patients  on  various  treatments,  and  extrapolating  available  data  to  project 
potential  future  gains  for  treated  patients. 

Dr.  Gelber's  experiences  with  the  development  and  application  of  the  Q-TWiST  method 
provided  the  motivation  to  pursue  the  proposed  special  sabbatical.  To  date  the  method 
has  been  used  only  with  data  routinely  available  in  clinical  trials  to  describe  quality-of- 
life  tradeoffs  in  treatment  comparisons.  Approaches  to  incorporate  information  obtained 
directly  from  the  patients  have  not  yet  been  used.  Modem  techniques  of  health  decision 
sciences  and  patient  input  for  clinical  decision-making  are  required  in  order  to  apply  the 
Q-TWiST  concepts  more  effectively  for  evaluation  of  treatments  for  breast  cancer 
patients. 
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Oncologists  have  come  to  rely  on  Kaplan-Meier  curves  for  disease-free  survival  (DFS) 
and  overall  survival  (OS)  to  evaluate  efficacy  of  treatments  in  clinical  trials.  The 
physician  can  use  these  results  to  describe  the  "percent  of  patients  who  benefit"  or  "the 
relative  reduction  in  the  risk  or  odds  of  an  event"  such  as  relapse  or  death.  However,  both 
patients  and  physicians  are  also  interested  in  how  the  various  treatments  may  influence 
duration  and  quality  of  life. 

Cancer  patient  care  decision-making  frequently  involves  evaluating  the  trade-off  between 
the  toxicity  of  therapy  and  the  treatment-induced  benefit  of  delayed  recurrence  of  the 
disease.  Q-TWiST  provides  the  opportunity  for  the  psychosocial  measures  of  quality  of 
life  to  influence  the  utility  weights  applied  to  the  periods  defined  by  TOX,  TWiST  and 
REL.  In  most  studies,  quality- of-life  assessments  are  made  independently  of  treatment 
efficacy  assessments.  The  result  is  often  that  the  treatment  is  shown  to  be  beneficial  in 
terms  of  disease-free  survival  or  overall  survival  while  the  quality  of  life  during  treatment 
is  lower  in  the  more  toxic  therapy  group.  The  Q-TWiST  method  bridges  the  gap  between 
these  two  assessments  and  allows  one  to  statistically  compare  treatments  studied  in 
clinical  trials  directly  in  terms  of  both  quantity  and  quality  of  life.  The  method  "speaks  to 
oncologists"  who  are  most  comfortable  with  disease-free  survival  and  overall  survival 
curves,  while  also  integrating  quality- of-life  issues  into  treatment  comparisons. 


SPECIFIC  AIMS 

1.  To  obtain  training  in  health  decision  sciences  methodologies  by  auditing  courses, 
attending  conferences  and  seminars,  and  reading  key  papers  under  the  mentorship  of 
Professor  Milton  C.  Weinstein,  Henry  J.  Kaiser  Professor  of  Health  Policy  and 
Management,  Harvard  School  of  Public  Health. 

2.  To  participate  in  a  research  project  involving  application  of  health  decision  science 
methods  to  a  problem  relating  to  breast  cancer  treatment  evaluation  -  specifically  the 
development  of  a  multi-attribute  utility  scale  for  quality  of  life  of  breast  cancer 
patients. 

3.  To  apply  health  decision  science  techniques  for  the  analysis  of  some  aspects  of 
adjuvant  therapy  based  on  the  data  from  the  Third  Update  of  the  Worldwide 
Overview  of  Randomized  Clinical  Trials  of  Adjuvant  Therapies  for  Breast  Cancer. 


Final  Progress  Report  Page  7 


Gelber,  Richard  D. 


BODY  -  PROGRESS  REPORT  ON  THE  SPECIFIC  AIMS 

The  funding  provided  by  this  Special  Sabbatical  Award  was  sufficient  to  cover  45  percent 
of  Dr.  Gelber's  salary  for  the  one  year  period  of  February  1,  1995  through  January  31, 
1996.  Other  salary  support  was  provided  from  sources  directly  related  to  ongoing 
research  on  studies  evaluating  treatments  for  breast  cancer. 


Specific  Aim  1.  To  obtain  training  in  health  decision  sciences  methodologies  by  auditing 
courses,  attending  conferences  and  seminars,  and  reading  key  papers  under  the 
mentorship  of  Professor  Milton  C.  Weinstein,  Henry  J.  Kaiser  Professor  of  Health 
Policy  and  Management,  Harvard  School  of  Public  Health. 

Professor  Milton  C.  Weinstein  served  as  the  "mentor"  for  training  in  health  decision 
sciences.  He  advised  Dr.  Gelber  regarding  courses  to  audit,  conferences  and  seminars  to 
attend,  and  literature  to  read  in  the  field.  Dr.  Weinstein  heads  the  Program  in  Health 
Decision  Sciences  at  the  Harvard  School  of  Public  Health.  The  material  below,  taken 
from  the  Course  Catalogue,  describes  the  program  and  the  three  courses  which  Dr.  Gelber 
attended  during  the  sabbatical  year: 

The  objective  of  the  Program  in  Health  Decision  Sciences  is  to  offer 
integrated  educational  training  in  decision  sciences  within  the  context  of 
health  problems. 

Decision  sciences  may  be  defined  as  the  body  of  knowledge  concerning 
quantitative  techniques  in  decision  making  at  the  individual  and  collective 
level.  It  includes  decision  analysis,  cost-benefit  and  cost-effectiveness 
analysis,  and  behavioral  decision  theory,  as  well  as  part  of  operations 
research,  applied  welfare  economics,  statistical  inference,  and  computer 
science.  Specific  course  offerings  provide  an  operational  definition  of  the 
field  at  the  School  of  Public  Health.  However,  while  methods  and  theory 
will  be  taught  rigorously,  the  primary  emphasis  of  the  program  is  on  their 
application  to  decisions  in  medicine,  health  care  policy,  and  the  physical 
and  social  environments. 


HPB  280b.  Decision  Analysis  for  Health  and  Medical  Practices  (Department 
of  Health  Policy  and  Management  and  the  Department  of  Biostatistics) 

Lectures.  Two  2-hour  sessions  each  week.  2.5  credits.  Dr.  Paltiel.  Concerns  the 
methods  and  applications  of  decision  analysis,  cost-effectiveness  analysis,  and 
cost-benefit  analysis  in  the  evaluation  of  medical  technologies  and  health 
programs.  Stresses  applications  and  limitations.  Examples  used  to  illustrate 
techniques  include:  treatment  decision  for  acute  abdominal  pain,  coronary  artery 
bypass  surgery,  cost  effectiveness  of  pharmaceuticals,  evaluation  of  immunization 
programs,  and  priority  setting  for  AIDS  prevention.  Course  emphasizes 
applications  to  medical  technology  assessment  and  health  care  resource  allocation. 

HPB  281c.  Clinical  Decision  Analysis  (Department  of  Health  Policy  and 
Management  and  the  Department  of  Biostatistics) 

Lectures,  seminars.  Two  2-hour  sessions  each  week.  2.5  credits.  Dr.  Weinstein. 
An  intermediate-level  course  on  methods  and  applications  of  decision  analysis 
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and  other  modeling  techniques  to  clinical  problems.  Topics  include:  Markov 
models,  life  expectancy  and  survival  modeling,  dynamic  models,  ROC  analysis 
and  diagnostic  technology  assessment,  quality  of  life  valuation,  multiattribute 
utility,  and  behavioral  decision  theory.  Class  sessions  include  presentation  of 
methods  and  critiques  of  published  analysis  of  medical  decision  problems. 
Students  will  learn  computer  software  for  decision  modeling. 

HPB  282d.  Cost-Effectiveness  and  Cost-Benefit  Analysis  for  Health  Program 
Evaluation  (Department  of  Health  Policy  and  Management  and  the 
Department  of  Biostatistics) 

Lectures,  seminars.  Two  2-hour  sessions  each  week.  2.5  credits.  Dr.  Graham. 

Topics  include:  methods  and  applications  of  cost-effectiveness  and  cost-benefit 
analysis  for  health  program  evaluation,  medical  technology  assessment,  and 
environmental  risk  analysis;  theoretical  foundations;  “shadow”  pricing;  economic 
valuation  of  life  saving;  choice  of  discount  rates;  cost  accounting  applied  to 
economic  evaluation  in  institutional  settings;  methods  for  assessing  costs  of 
environmental  controls;  economic  evaluation  of  biomedical  research;  health  status 
indexes;  ethical  issues;  and  modem  critiques. 

In  addition  to  participating  formally  in  the  three  courses  described  above.  Dr.  Gelber  also 
attended  regularly  scheduled  Risk  Analysis  and  Decision  Sciences  seminars,  sponsored 
by  the  Harvard  Center  for  Risk  Analysis,  held  every  two  weeks  during  the  academic  year. 

In  March,  1995,  Dr.  Jane  Weeks,  Assistant  Professor  in  Medicine,  Dana-Farber  Cancer 
Institute,  and  an  expert  in  the  field  of  cost-effectiveness  analysis,  established  the  Center 
for  Outcomes  and  Policy  Research  (COPR)  at  DFCI.  As  a  result  of  the  special  sabbatical 
award,  Dr.  Gelber  was  able  to  become  a  member  of  COPR  faculty.  Other  faculty 
members  include  Drs.  Ezekiel  Emanuel,  Isaac  Kohane,  David  Paltiel,  Susan  Parsons,  and 
Milton  Weinstein.  Dr.  Gelber  attended  the  weekly  seminars  sponsored  by  COPR.  He 
also  presented  his  research  at  three  of  the  sessions  of  this  group  during  the  sabbatical 
year.  Topics  included  obtaining  patient-centered  assessments  of  preferences  for  adjuvant 
therapies  of  breast  cancer  and  applications  of  the  Q-TWiST  method  to  data  from  the 
Worldwide  Overview. 

Dr.  Gelber  was  invited  to  be  a  speaker  at  the  December  1-2  symposium  held  in  Brussels 
entitled  "Methodological  and  Statistical  Issues  of  Quality  of  Life  and  Economic 
Evaluation  in  Cancer  Clinical  Trials".  The  symposium  was  sponsored  by  the  European 
Organization  for  Research  on  the  Treatment  of  Cancer  (EORTC).  Dr.  Gelber  presented  a 
paper  entitled  "Integration  of  length-of-life  outcomes  and  quality-of-life  data  in  cancer 
clinical  trials"  which  is  now  in  press  and  acknowledges  the  support  of  this  special 
sabbatical  award.  1  This  work  incorporated  some  of  the  principles  of  health  decision 
sciences  applied  to  the  evaluation  of  clinical  trial  data. 

Dr.  Gelber  is  also  on  the  planning  committee  for  another  symposium  on  Statistical  Issues 
in  Quality  of  Life  Assessment  in  Clinical  Trials.  This  symposium  is  scheduled  for  July, 
1996,  in  St.  Gallen,  Switzerland.  In  addition  to  developing  themes  relating  to  patient- 
centered  decision  making  for  breast  cancer  therapies,  Dr.  Gelber  is  participating  in  a 
workshop  on  methodologies  for  evaluating  longitudinal  assessments  of  quality  of  life. 
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Specific  Aim  2.  To  participate  in  a  research  project  involving  application  of  health 
decision  science  methods  to  a  problem  relating  to  breast  cancer  treatment  evaluation 
-  specifically  the  development  of  a  multi-attribute  utility  scale  for  quality  of  life  of 
breast  cancer  patients. 

The  goal  of  this  aim  was  for  Dr.  Gelber  to  participate  in  a  research  project  relating  to 
breast  cancer  patient  preferences  and  clinical  decision  making.  The  project  was  designed 
by  Dr.  Jane  Weeks,  Assistant  Professor  in  Medicine,  Dana-Farber  Cancer  Institute  and 
was  entitled:  "Validation  and  Implementation  of  a  Novel  Approach  to  Quality  of  Life  and 
Preference  Assessment  in  Breast  Cancer  Patients."  It  was  submitted  for  funding  as  a 
research  project  for  support  by  the  United  States  Army  Medical  Research  and 
Development  Command  as  part  of  the  Broad  Agency  Announcement  for  Breast  Cancer 
Research.  Dr.  Gelber  planned  to  participate  actively  in  this  area  of  patient  preference 
assessment  research  as  it  represents  an  important  new  initiative  for  enhancing  the 
usefulness  of  the  Q-TWiST  methodology  and  improving  the  relevance  of  clinical  trial 
reports  for  patient  care  decision-making. 

Unfortunately,  Dr.  Weeks'  project  was  not  funded.  Thus,  we  were  not  able  to  accomplish 
during  the  sabbatical  year  the  development  of  a  multi-attribute  utility  scale  for  quality-of- 
life  assessment  suitable  for  clinical  trial  applications.  Nevertheless,  we  continued  to 
pursue  this  important  area  of  research  by  preparing  another  application  for  funding  from 
the  Susan  B.  Komen  Foundation.  This  application  was  prepared  in  collaboration  with 
Drs.  Weeks  and  Weinstein.  The  summary  of  the  grant  application  is  included  in  the 
Appendix.  We  proposed  an  interview  evaluation  of  postmenopausal  women  with  breast 
cancer  who  had  undergone  chemotherapy.  Our  intention  was  to  obtain  information  on 
their  quality  of  life  as  well  as  on  their  preferences  for  the  various  treatment  options 
available.  Attitudes  toward  recurrence  of  the  disease  were  also  to  be  ascertained.  The 
information  to  be  obtained  from  this  research  would  provide  patient  input  for  the 
appropriate  interpretation  of  the  analyses  conducted  on  the  Overview  data  (see  Specific 
Aim  3).  Unfortunately,  we  were  just  informed  that  the  Komen  Foundation  was  not  able 
to  support  this  patient-centered  research  project.  We  are  continuing,  however,  to  seek 
grant  support  that  will  incorporate  patient  preferences  in  evaluations  of  treatment 
decision-making. 

An  additional  step  was  taken  during  the  year  to  investigate  the  role  of  the  Q-TWiST 
method  for  obtaining  information  on  the  comparative  effectiveness  of  two  treatment 
options.  Dr.  Gelber  collaborated  with  Drs.  Jane  Weeks  and  Milton  Weinstein  to  develop 
a  strategy  designed  to  compare  a  variety  of  ways  to  calculate  cost-effectiveness  ratios,  the 
measures  which  are  receiving  increasing  acceptance  by  health  decision  policy-makers.  A 
grant  to  support  this  further  research  was  prepared.  The  Q-TWiST  method  represents  a 
potentially  valuable  user-friendly  way  to  obtain  the  measure  of  effectiveness  which  goes 
into  the  denominator  of  a  cost-effectiveness  analysis  (CEA).  By  defining  clinical  health 
states  and  estimating  patient  preferences  for  these  health  states,  Q-TWiST  avoids  the 
need  to  collect  frequent  longitudinal  assessments  of  patient  preferences  over  time.  In 
addition,  a  variety  of  ways  to  determine  patient  preferences  (direct  assessment,  holistic 
approach,  and  multi-attribute  approach)  will  be  assessed  to  identify  user-friendly 
approximations  to  the  current  standards.  Finally,  cost  data  will  be  collected  to  determine 
how  different  approaches  can  influence  the  CEA.  The  application  has  been  submitted  to 
NIH  for  review. 
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During  this  sabbatical  year,  Dr.  Gelber  contributed  significantly  to  understanding  the 
impact  of  the  timing  and  duration  of  adjuvant  chemotherapy  for  patients  with  breast 
cancer.  Two  large  randomized  clinical  trials  conducted  by  the  International  Breast 
Cancer  Study  Group  (IBCSG:  formerly  Ludwig  Group)  on  over  2700  patients  reached 
five  years  of  follow-up.  Since  1978,  this  cooperative  group  has  conducted  large, 
randomized  clinical  trials  evaluating  adjuvant  therapies  for  breast  cancer.  Over  8000 
patients  were  enrolled  in  seven  randomized  trials  that  have  completed  recruitment,  and 
patient  entry  is  continuing  in  seven  other  newly  activated  trials.  Participating  centers  are 
located  in  ten  countries,  and  the  operations  office  is  in  Bern,  Switzerland. 

For  1475  premenopausal  patients  with  node-positive  disease,  a  recently  completed  trial 
showed  that  three  cycles  of  adjuvant  CMF  therapy  were  less  effective  at  preventing 
disease  recurrence  than  six  or  nine  cycles  of  CMF.2  The  trial  also  showed  that 
reintroduction  of  chemotherapy  after  a  treatment-free  interval  was  associated  with  a 
modest  improvement  in  disease-free  survival.  For  1212  postmenopausal  patients  with 
node-positive  disease,  another  recently  completed  trial  showed  that  three  cycles  of 
adjuvant  CMF  added  to  tamoxifen  was  significantly  more  effective  at  preventing  disease 
recurrence  than  tamoxifen  alone. 3  This  trial  also  showed  that  late  introduction  of  CMF 
after  the  initiation  of  tamoxifen  therapy  was  detrimental,  especially  for  patients  with 
estrogen-receptor-negative  tumors.  This  finding  provides  clinical  evidence  supporting 
the  in  vitro  experimental  data  showing  an  antagonism  between  tamoxifen  and  specific 
cytotoxic  agents;  it  also  suggests  that  the  common  practice  to  start  tamoxifen  prior  to  a 
chemotherapy  consult  for  postmenopausal  patients  could  be  dangerous. 

Approximately  eighty  percent  of  the  patients  included  in  the  two  clinical  trials 
summarized  above  had  self-reported  quality- of-life  (QL)  assessments  obtained.  Patients 
completed  linear-analogue  self-assessment  scales  for  physical  well-being,  mood,  appetite 
and  effort  to  cope  with  the  disease.  Assessments  were  obtained  at  randomization  and 
then  at  3-month  intervals  throughout  treatment  and  follow-up.  We  found  that  baseline 
QL  scores  were  worse  in  patients  with  higher  numbers  of  involved  axillary  nodes  and 
those  with  estrogen-receptor  negative  tumors.  During  adjuvant  therapy,  all  treatment 
groups  showed  substantial  improvement  in  QL  scores.  Patterns  of  QL  scores  closely 
reflected  presence,  duration  and  timing  of  cytotoxic  treatment.  Longer  initial  cytotoxic 
therapy  delayed  improvement  in  QL.  Later  cytotoxic  therapy  had  transient  adverse 
effects.  Anticipation  of  future  therapy  also  affected  QL  scores.  Overall,  chemotherapy 
had  a  measurable  adverse  effect  on  QL,  but  this  was  transient  and  minor  compared  to 
patients'  adaptation  following  diagnosis  and  surgery.  The  absence  of  a  lasting  loss  of  QL 
should  encourage  patients  and  doctors  to  choose  appropriate  therapy  with  less  concern  for 
initial  toxicity.  This  research  using  patient  self-assessments  is  in  press  in  The  Lancet 4 
and  represents  an  important  contribution  of  patient-derived  information  to  be  used  for 
treatment  selection. 


SPECIFIC  AIM  3.  To  apply  health  decision  science  techniques  for  the  analysis  of  some 
aspects  of  adjuvant  therapy  based  on  the  data  from  the  Third  Update  of  the 
Worldwide  Overview  of  Randomized  Clinical  Trials  of  Adjuvant  Therapies  for 
Breast  Cancer. 

The  special  sabbatical  year  coincided  with  the  1995-1996  update  of  the  Early  Breast 
Cancer  Trialists'  Collaborative  Group  (EBCTCG)  Overview  of  therapies  for  breast 
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cancer.  Dr.  Gelber  actively  participated  in  the  meeting  of  the  Group,  held  in  Oxford, 
England,  in  September,  1995.  Proposals  were  made  to  access  the  data  to  perform 
analyses  based  on  health  decision  science  methodologies  learned  during  the  special 
sabbatical  training.  Specifically,  a  Q-TWiST  analysis  of  the  data  based  on  patient- 
derived  preferences  is  envisioned.  The  Overview  data  will  also  be  used  to  form  the  basis 
for  a  cost-effectiveness  analysis  on  the  role  of  adjuvant  therapies  for  breast  cancer  within 
the  context  of  cost-containment  in  health  care. 

Dr.  Gelber's  interest  in  methods  for  meta-analysis  has  been  stimulated  by  active 
participation  since  1984  in  the  Early  Breast  Cancer  Clinical  Trials  Group  (coordinated  by 
the  Clinical  Trials  Service  Unit,  Oxford  University,  Richard  Peto  -  Director).  This  group 
conducted  two  major  Overviews  of  randomized  trials  evaluating  adjuvant  therapies,  most 
recently  in  1992.  Dr.  Gelber  served  on  the  planning  committee  for  the  Overview  and  is  a 
member  of  the  Hormone  Receptor  Working  Group  chaired  by  C.  Kent  Osborne.  He  has 
published  several  commentaries  on  the  overview  methodology  and  interpretation  of 
results. 

During  the  last  decade,  the  meta-analysis,  or  overview,  has  become  an  increasingly 
popular  method  for  making  treatment  comparisons.  This  method  involves  combining 
results  of  several  randomized  trials  with  common  treatment  arms  in  order  to  increase  the 
statistical  power  to  detect  treatment  effects.  The  second  update  of  the  breast  cancer 
overview  was  published  by  the  EBCTCG  in  the  Lancet  in  January,  1992.  This  work  used 
evidence  derived  from  over  75,000  women  with  operable  breast  cancer  enrolled  in 
randomized  trials  between  1957  and  1985  to  demonstrate  that  poly  chemotherapy, 
tamoxifen,  and  ovarian  ablation  were  modalities  that  improved  recurrence-free  survival 
and  overall  survival  for  these  patients.  Perhaps  the  three  most  surprising  features  of  this 
remarkable  international  collaboration  were:  (1)  the  overwhelming  effect  on  recurrence- 
free  and  overall  survival  of  ovarian  ablation  for  younger  women,  (2)  the  demonstration  of 
a  continuously  increasing  survival  benefit  for  treated  patients  more  than  5  years  after 
adjuvant  systemic  therapy,  and  (3)  the  evidence  that  chemoendocrine  treatment  yields  an 
additional  benefit  compared  with  either  modality  alone. 

The  statistical  methods  used  in  the  Overview  provide  estimates  of  the  relative  reduction 
in  the  risk  of  an  event  for  the  treated  group  compared  with  the  control  group.  While  these 
ratio  measures  are  appropriate  for  investigating  whether  a  treatment  modality  has  any 
effect  at  all,  absolute  measures  are  crucial  for  assessing  the  magnitude  of  patient  benefit. 
Health  decision  sciences  methods  focus  on  the  latter  types  of  measures  as  they  are  most 
relevant  for  recommending  treatments  for  a  patient  population. 

The  data  from  the  Third  Update  of  the  Overview  are  being  evaluated  now  by  the  Oxford 
secretariat  for  the  primary  evaluations  using  previously  used  methods.  The  publications 
should  be  completed  by  the  end  of  1996,  after  which  time  data  access  will  be  sought.  In 
the  meantime,  data  from  the  1992  Overview  were  obtained  and  used  to  perform  two  Q- 
TWiST  analyses  to  incorporate  aspects  of  quality  of  life  into  meta-analysis.  These 
analyses  demonstrate  the  potential  use  of  Q-TWiST  for  patient-oriented  treatment 
comparisons  and  provide  the  pilot  study  framework  for  conducting  cost-effectiveness 
analyses  based  on  the  Overview  data. 

In  collaboration  with  the  EBCTCG  and  with  the  permission  of  all  collaborating  trialists,  a 
Q-TWiST  meta-analysis  of  adjuvant  chemotherapy  for  premenopausal  breast  cancer 
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patients  was  performed.  The  paper  acknowledged  the  support  of  this  Special  Sabbatical 
Award  and  was  published  in  The  Cancer  Journal  of  Scientific  American.^  Data  were 
used  from  1,229  node-positive  breast  cancer  patients  49  years  of  age  and  younger  who 
were  randomized  in  all  eight  clinical  trials  comparing  chemotherapy  (CMF)  versus  no 
adjuvant  systemic  therapy. 

Q-TWiST  analyses  were  performed  on  the  individual  trials  to  obtain  DFS  and  OS 
differences  between  treatments.  These  individual  trial  results  were  combined  with  a 
multiple  regression  model  using  the  median  follow-up  time  for  each  trial  as  the 
independent  variable,  and  the  corresponding  OS  and  DFS  as  the  dependent  variables.  For 
this  analysis,  the  health  state  TOX  was  defined  as  six  months,  since  the  current  standard 
CMF  regimen  for  this  disease  is  six  months.  The  resulting  threshold  utility  plots,  at  five- 
and  ten-year  timepoints,  were  drawn.  The  10-year  plot  showed  that,  for  all  values  of  the 
utility  coefficients  (patient  preferences),  the  treated  group  was  preferred  to  the  control 
group;  furthermore,  for  most  utility  coefficients,  the  difference  was  statistically 
significantly  (p  <  0.05).  (see  manuscript  in  the  appendix) 

The  second  Q-TWiST  meta-analysis,  performed  during  the  sabbatical  year,  investigated 
the  role  of  combination  chemotherapy  plus  tamoxifen  compared  with  tamoxifen  alone  for 
the  treatment  of  postmenopausal  breast  cancer  patients.  The  paper  reporting  the  results  of 
the  analysis  acknowledges  the  support  of  the  Special  Sabbatical  Award  and  is  in  press  at 
The  Lancet .6  In  collaboration  with  the  EBCTCG  and  with  the  permission  of  all 
collaborating  trialists,  a  Q-TWiST  analysis  was  performed  based  on  data  from  3920 
patients  50  years  of  age  or  older  with  node-positive  breast  cancer  randomized  in  nine 
clinical  trials  comparing  combination  chemotherapy  plus  tamoxifen  versus  tamoxifen 
alone. 

The  methods  used  for  this  analysis  were  the  same  as  those  for  the  premenopausal 
evaluation  described  above.  In  contrast  to  the  positive  results  obtained  for  the  evaluation 
of  chemotherapy  in  premenopausal  women,  the  results  for  postmenopausal  women  were 
less  impressive.  Within  seven  years  of  follow-up  the  modest  benefit  of  increased  relapse- 
free  and  overall  survival  for  patients  who  received  chemotherapy  just  balanced  the 
burdens  in  terms  of  acute  toxic  side  effects.  Chemotherapy-treated  patients  gained  an 
average  of  5.4  months  of  relapse-free  survival  and  2  months  of  overall  survival  (neither 
statistically  significant),  but  had  to  receive  cytotoxic  treatment  for  2  to  24  months  to 
achieve  these  gains.  There  were  no  values  of  utility  weights  for  time  spent  undergoing 
chemotherapy  and  time  after  relapse  for  which  the  chemotherapy  plus  tamoxifen  program 
produced  significantly  more  Q-TWiST  than  tamoxifen  alone.  The  nine  trials  included  in 
this  meta-analysis  were  mostly  conducted  during  the  early  80s  and  many  included  long 
duration  chemotherapy  and  short  duration  tamoxifen.  The  use  of  shorter  duration 
chemotherapy  combined  with  longer  duration  tamoxifen,  which  will  be  reflected  much 
more  in  the  future  Overview  Update  analyses,  may  improve  the  benefit  to  burden  ratio  for 
chemotherapy.  Nevertheless,  the  Q-TWiST  analysis  performed  on  the  available 
Overview  data  indicated  that  patient  preference  for  or  against  adjuvant  chemotherapy 
should  be  a  factor  influencing  treatment  selection  for  postmenopausal  breast  cancer 
patients. 

The  special  sabbatical  provided  the  opportunity  to  develop  methods  for  a  more  precise 
and  patient- oriented  analysis  of  the  updated  results  from  the  1995  Overview.  While 
individual  utility  assessments  are  not  available  from  every  patient  included  in  the 
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Overview,  some  data  are  available  from  some  of  the  clinical  trials.  For  example,  quality- 
of-life  data  has  been  obtained  from  all  patients  enrolled  in  IBCSG  trials  since  1986.  The 
multi-attribute  utility  theory  taught  in  the  Harvard  School  of  Public  Health  courses,  and 
the  preference  weight  formulas  being  developed  by  Drs.  Weeks  and  Weinstein  can  be 
used  to  translate  these  data  into  utility  estimates  for  treatment  toxicity  and  disease 
progression  endpoints.  With  these  patient-derived  estimates  of  preference,  the  Q-TWiST 
meta-analyses  to  be  conducted  on  the  third  Overview  update  will  have  even  more  direct 
relevance  for  patient  care. 


CONCLUSIONS 

In  summary,  the  overall  objectives  of  the  Special  Sabbatical  Award  were  accomplished. 
Dr.  Gelber  received  much  needed  additional  training  in  health  decision  sciences  research 
(Specific  Aim  1).  He  was  also  able  to  perform  Q-TWiST  analyses  based  on  data  from  the 
Worldwide  Overview  to  answer  patient-oriented  questions  concerning  the  benefits  of 
adjuvant  chemotherapy  for  premenopausal  breast  cancer  patients,  and  adjuvant 
chemoendocrine  therapy  for  postmenopausal  patients  (Specific  Aim  3).  Unfortunately, 
funding  needed  to  fully  realize  data  collection  from  patients  to  develop  a  user-friendly 
multi-attribute  utility  function  was  not  forthcoming  (Specific  Aim  2).  However,  plans  for 
such  a  study  were  developed  and  applications  to  secure  the  needed  funding  were 
prepared.  Preliminary  data  on  the  impact  of  chemotherapy  on  patients’  self-report  of  their 
quality  of  life  were  analyzed  in  the  International  Breast  Cancer  Study  Group  trials.  This 
will  provide  further  justification  to  develop  methods  designed  to  incorporate  patient 
preferences  into  treatment  selection. 

Q-TWiST  is  a  method  designed  to  include  aspects  of  quality  of  life  into  an  evaluation  of 
treatment  comparisons.  The  results  of  Q-TWiST  analyses  of  randomized  clinical  trials 
can  provide  unbiased  estimates  of  the  relative  effectiveness  of  two  competing  treatment 
approaches.  These  estimates  are  the  values  for  treatment  effectiveness  which  go  into  the 
denominator  of  cost-effectiveness  ratios.  The  method  highlights  how  the  choice  of 
patient  preference  weights  can  influence  treatment  selection.  The  next  step  in  this 
approach  is  to  design  studies  which  elicit  these  patient  preferences.  In  this  way,  the 
points  of  view  of  breast  cancer  patients  can  be  incorporated  into  the  treatment  decision¬ 
making  process. 
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I.  Introduction 


The  evaluation  of  treatments  in  cancer  clinical  trials  utilizes  a  variety  of  end  points, 
including  overall  survival,  disease-free  survival,  tumor  response,  treatment  toxicity  and 
quality-of-life  assessment.  If  all  measured  end  points  favor  the  same  therapeutic  regimen, 
then  the  clinical  trial  results  are  clear  and  patient  care  is  positively  influenced.  However, 
it  is  not  uncommon  for  end  points  to  provide  conflicting  information  as  to  the  most 
beneficial  treatment  for  the  patient.  Frequently  the  most  efficacious  cancer  therapy  is 
also  the  most  toxic,  thus  making  it  necessary  to  consider  the  tradeoffs  between  an 
overall  survival,  or  disease-free  survival,  advantage  and  a  quality-of-life  decrement. 

There  are  two  general  approaches  to  quality-of-life  (QOL)  assessments:  psychometric  or 
health  status  assessment  and  the  decision  theory  or  economic  approach.  The  first 
evaluates  QOL  using  instruments  which  assess  a  patient  in  multiple  domains  (e.g., 
physical,  psychological,  social)  and  reports  a  profile  of  QOL  on  these  areas,  sometimes 
with  a  summary,  global  health  score.  The  second  approach  evaluates  the  patient's 
overall  health-related  QOL  using  a  single  number  to  express  the  net  benefit  of  treatment. 
This  approach  is  not  limited  by  the  need  to  determine  which  domains  are  relevant  to 
measure  for  a  particular  trial  nor  whether  all  the  domains  should  be  given  equal 
importance.  It  is  this  second  approach  which  is  most  commonly  used  to  integrate  length 
of  life  and  quality  of  life. 

This  paper  is  intended  to  be  a  brief  review  of  some  key  aspects  relating  to  integrating 
quality  and  quantity  of  life  with  the  purpose  of  raising  a  variety  of  questions  to  stimulate 
discussion. 


II.  Quality-adjusted  Survival 

Quality-adjusted  survival  (QAS)  analysis  makes  treatment  comparisons  in  terms  of 
quality  and  quantity  of  life  by  penalizing  treatments  which  have  negative  quality-of-life 
effects  and  rewarding  those  which  increase  survival  and  have  other  positive  quality-of- 
life  effects.1  As  in  an  ordinary  survival  analysis,  the  focus  of  the  method  is  on  time,  but, 
rather  than  look  at  a  single  end  point  such  as  overall  survival,  or  disease-free  survival, 
multiple  outcomes  corresponding  to  changes  in  quality  of  life  are  considered.  Periods  of 
time  with  the  negative  side  effects  of  treatment  are  weighted  according  to  the  severity  of 
the  side  effects,  and  periods  of  time  with  disease  progression  are  weighted  according  to 
the  severity  of  the  symptoms.  A  weight  of  zero  indicates  the  period  of  time  is  as  bad  as 
death  and  a  weight  of  one  indicates  perfect  health.  Weights  between  zero  and  one 
indicate  degrees  between  these  extremes.  These  weights  are  called  utility  scores  or 
utility  coefficients.  In  order  for  the  multiplication  of  duration  and  quality  to  be 
meaningful,  the  value  associated  with  a  period  of  time  must  be  measured  in  units  on  an 
interval  scale.  A  composite  measure  of  quality  and  quantity  of  life  (i.e.,  quality-adjusted 
survival)  is  obtained  by  summing  the  weighted  periods  of  time.  For  example,  if  ui 
represents  the  utility  score  and  si  represents  the  duration  for  time  period  i,  and  there  are  k 
time  periods  over  the  course  of  a  lifetime,  then  the  quality-adjusted  survival  calculated 
over  all  k  time  periods  is  given  by 

k 

QAS  =  I  ui  si.  (1) 

i=l 
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This  summary  measure  can  be  used  for  treatment  comparisons  and  for  the  effectiveness 
component  in  cost-effectiveness  analysis. 

The  above  QAS  model  makes  three  main  assumptions  about  individual  preferences:  (1) 
utility  independence,  (2)  risk  neutrality,  and  (3)  context  independence.  Utility 
independence  implies  that  the  utility  score  for  each  period  of  time  does  not  depend  on 
the  length  of  the  period;  that  is,  the  utility  scores  can  be  specified  independently  of  the 
duration  of  the  survival  period.  Risk  neutrality  implies  that  utility  is  directly 
proportional  to  the  length  of  life.  This  assumption  can  be  relaxed  by  discounting  future 
gains  in  the  model;  with  discounting,  an  extra  year  of  life  in  the  distant  future  is  made 
less  valuable  than  an  extra  year  of  life  in  the  immediate  future.  Context  independence 
means  that  the  utility  assigned  to  a  given  period  of  time  is  independent  of  the  previous 
(or  future)  quality  of  life  experienced  before  (or  after)  the  given  time  period. 

Assessment  of  the  utility  scores  has  several  limitations:2  (1)  An  individual's  preferences 
may  vary  depending  on  circumstances.  For  example,  a  person's  preferences  may  change 
if  he  or  she  is  experiencing  economic  stress.  (2)  Utility  scores  are  sometimes  elicited  from 
individuals  who  have  not  experienced  the  condition  under  study.  This  is  usually  the 
case  when  multi-attribute  techniques3  are  used.  (3)  It  is  difficult  for  some  individuals  to 
respond  to  questions  involving  risks  and  gambles.  For  example,  Fowler  et  al.4  found 
that  for  people  who  are  reluctant  to  give  up  any  life  at  all,  any  questions  involving  risk 
or  trading  life  years  may  be  poor  measures  of  health  status.  (4)  Bias  results  when 
patients  provide  the  answers  that  they  believe  are  preferred  by  the  investigator. 

There  is  much  debate  regarding  whose  preferences  should  be  used:  patients,  health  care 
providers,  relatives  or  the  general  public.  Patients  often  adapt  to  their  illness  and  their 
utility  scores  improve  even  though  their  condition  remains  stable.  Health  care  providers 
have  knowledge  of  the  entire  disease  process  but  rarely  have  personal  experience. 
Relatives  are  sometimes  used  as  surrogates  for  patients  and  utility  values  from  the 
general  public  are  frequently  used  for  health  policy  decisions. 

QAS  analyses  have  been  performed  in  two  different  ways:  the  QALY  method  and  the  Q- 
TWiST  method.  In  a  QALY  (Quality-Adjusted  Life  Year)  analysis,  specified  intervals  are 
defined  prospectively  based  on  the  calendar  time  points  at  which  utility  assessments  are 
to  be  obtained.  In  a  Q-TWiST  (Quality- adjusted  Time  Without  Symptoms  and  Toxicity) 
analysis,  the  course  of  the  patients'  treatment  and  follow-up  is  partitioned  into  health 
states  that  are  clinically  relevant  for  the  therapies  under  consideration,  and  a  utility  score 
is  assigned  to  each  clinical  health  state.  In  the  next  two  sections,  we  describe  these 
methodologies  in  more  detail. 


HI.  QALY  Analysis 

QALYs  were  first  proposed  in  the  medical  decision  analysis  field.5  Using  serial  utility 
scores  obtained  from  each  patient,  the  total  QALYs  can  be  computed  for  an  individual 
patient.  The  total  QALYs  is  defined  as  the  sum  of  the  products  of  each  assessed  utility 
score  multiplied  by  the  duration  of  the  time  period  being  measured.  The  time  period  for 
each  assessment  is  generally  taken  to  begin  and  end  at  the  mid-points  between  the 
scheduled  sequential  assessments.  For  example,  a  particular  trial  lasting  18  months  might 
obtain  patient  derived  utility  scores  at  months  3,  9  and  15,  and  the  values  would  be 
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applied  to  the  six  month  intervals  0  to  6,  6  to  12,  and  12  to  18.  Thus,  if  the  utility 
assessment  at  month  3  were  0.82,  the  assessment  at  month  9  were  0.90,  and  the 
assessment  at  month  15  were  0.84,  the  patient  would  have  experienced  1.28  QALYs 
during  the  1.50  year  period  of  study6  (see  Figure  1).  Utility  scores  of  zero  are  used  for 
patients  who  have  died.  The  QALYs  for  all  patients  in  a  given  treatment  arm  are  then 
averaged  to  provide  a  QALY  estimate  for  that  therapy.  If  complete  utility  assessments 
are  available,  treatment  comparisons  can  be  performed  using  t-tests  or  Wilcoxon  tests  as 
appropriate. 


Utility 

of  6  f  12  t  18 

Months 

Figure  1.  QALYs  equal  the  area  under  the  curve.  The  height  of  the  curve  is  based  on  the 
utility  assessments  obtained  at  3,  9,  and  12  months  as  indicated  by  the  arrows. 


QALY  analyses  have  not  frequently  been  performed  in  clinical  trials  due  to  several 
limitations.  First,  the  method  requires  serial  utility  assessments.  The  most  accepted 
methods  for  obtaining  these  assessments  are  the  standard  gamble  and  time  tradeoff,7 
both  of  which  require  lengthy  individual  interviews  that  are  often  not  feasible.  The 
more  commonly  used  cancer  quality-of-life  measures  (EORTC  QLQ-C30,8  FACT,9 
FLIC10)  are  not  currently  transformable  into  utility  scores.  Utilities  may  be  obtained, 
however,  by  using  certain  health  status  questionnaires  which  map  health  states  into 
utility  scores.  The  McMaster  Health  Utilities  Indexes  (HUI),3  Quality  of  Well-Being 
Scale  (QWB)11,  York  Questionnaire, 1243  Spitzer's  Quality  of  Life  Index14  and  EuroQol15 
have  been  linked  to  utility  scores  and  several  clinical  trials  have  used  these  instruments 
to  elicit  utilities. 

A  second  limitation  to  QALY  analyses  is  the  problem  which  arises  from  missing  data  in 
longitudinal  assessments.  If  a  patient  has  not  furnished  a  utility  assessment  at  a 
particular  time  point,  then  there  will  be  incomplete  data  for  that  individual.  Patients  who 
are  too  sick  to  provide  a  utility  would  thus  be  eliminated  from  the  analysis,  yielding  a 
summary  QALY  score  reflecting  the  healthier  patients.  One  possibility  is  to  impute  a 
value  for  missed  assessments,  but  this  involves  making  assumptions  as  to  why  the 
assessment  was  missed  and  what  the  utility  score  might  have  been. 

/-one 

A  third  limitation  for  calculating  QALYs  in  clinical  trials  relates  to  the  handling  of 
censored  observations.  Not  all  patients  in  the  trml  will  be  followed  long  enough  to  have 
completed  all  utility  assessments.  In  this  case,  it  might  be  tempted  to  use  Kaplan-Meier 
methodology16  directly  on  the  accumulated  QALY  score  for  each  patient  up  to  his  or 
her  follow-up  time.  Such  an  estimate  is  biased,  however,  because  the  distribution  of 
QALY  scores  and  the  censoring  distribution  (related  to  administrative  follow-up)  are  not 
statistically  independent;  the  analysis  is  subject  to  "informative"  censoring.  Patients 
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with  low  QOL  weights  will  accumulate  QALYs  more  slowly  than  patients  with  better 
QOL  and,  thus,  will  be  censored  earlier  in  the  Kaplan-Meier  analysis.16  Therefore,  even  if 
serial  utility  assessments  are  available  within  a  clinical  trial,  methods  must  be  developed 
to  appropriately  account  for  missing  and  censored  observations. 


IV.  Q-TWiST 

The  Q-TWiST  method  was  developed  to  evaluate  adjuvant  therapies  for  breast 
cancer12*18  and  has  been  applied  to  treatment  comparisons  for  rectal  cancer,19 
melanoma20  and  HIV  infection.21’22  Instead  of  forming  QAS  estimates  from  each 
individual's  history,  the  average  amounts  of  time  patients  spend  in  QOL-oriented  clinical 
health  states  are  estimated,  and  these  are  recombined  using  a  weighted  average  to  form 
the  Q-TWiST  estimates.  This  procedure  can  be  used  with  censored  data  without  the 
difficulties  associated  with  informative  censoring  described  above.  The  three  steps 
involved  in  applying  the  Q-TWiST  method  are  reviewed  briefly  below  23 

1)  The  first  step  is  to  define  progressive  quality-of-life  oriented  clinical  health  states  that 
highlight  differences  between  the  treatments  being  compared.  For  example,  in  the 
case  of  adjuvant  chemotherapy  for  resectable  breast  cancer,  the  time  with  toxicity 
(TOX)  is  represented  by  the  period  in  which  the  patient  is  exposed  to  subjective  side 
effects  of  therapy;  the  time  without  symptoms  of  disease  or  toxicity  of  treatment 
(TWiST)  is  a  state  of  relatively  good  quality  of  life;  and  time  spent  living  with  overt 
metastatic  disease  or  time  in  relapse  (REL)  represents  all  time  after  the  diagnosis  of 
systemic  spread  of  the  disease.  The  definitions  of  TOX  and  REL  reflect  the  fact  that 
these  periods  of  time  have  a  negative  impact  on  the  overall  quality  of  life  of  the 
patient.  Furthermore,  their  definition  is  designed  to  emphasize  the  contrasting 
properties  of  the  different  treatments  under  study.  Each  Q-TWiST  application 
requires  a  careful  definition  and  data  collection  to  identify  individual  patient 
transitions  between  the  clinical  health  states. 

2)  The  second  step  is  to  consider  each  treatment  separately  and  to  partition  the  overall 
survival  time  into  the  clinical  health  state  durations  using  data  for  the  transition  times 
between  the  states  defined  in  Step  1 .  For  example,  areas  between  the  Kaplan-Meier 
estimates16  for  overall  survival  (OS),  disease-free  survival  (DFS),  and  time  to  end  of 
toxicity  (TOX)  represent  the  average  amounts  of  time  spent  in  the  respective  clinical 
health  states:  TOX,  TWiST=DFS-TOX,  and  REL=OS-DFS.  These  are  calculated  up  to 
a  specific  point  in  time  determined  by  the  follow-up  limits  of  the  study  cohort.  The 
resulting  estimates  are  called  restricted  means 16  because  they  represent  the  mean 
survival  time  within  the  follow-up  interval.  The  survival  curves  for  the  outcomes  can 
be  plotted  on  the  same  graph  to  illustrate  the  partitioning  according  to  treatment 
group  (Figure  2).  This  is  known  as  a  partitioned  survival  analysis.1 

3)  The  third  step  is  to  compare  the  treatment  regimens  in  terms  of  quality-adjusted 
survival.  This  composite  measure  is  obtained  by  summing  the  average  clinical  health 
state  durations  calculated  in  Step  2  multiplied  by  utility  coefficients.  The  bootstrap 
method  may  be  used  to  produce  confidence  intervals  for  the  treatment  effect  (mean 
difference  between  treatment  groups)  on  quality- adjusted  survival.1 
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(A)  Short  Duration 
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Figure  2.  Partitioned  survival  for  the  long  duration  treatment  (A)  and  for  the  short 
duration  treatment  (B)  for  1,229  patients  in  International  Breast  Cancer  Study  Group 
(IBCSG)  Trial  V  at  7  years  of  median  follow-up.18*28  in  each  graph,  the  area  under  the 
overall  survival  curve  (OS)  is  partitioned  by  the  survival  curves  for  disease-free  survival 
(DFS)  and  time  with  treatment  toxicity  (TOX).  The  areas  between  the  survival  curves 
give  the  average  months  spent  in  TOX,  TWiST  and  REL  as  indicated. 


In  the  breast  cancer  example,  we  may  suppose  that  the  utility  coefficient  for  TWiST  is 
one  because  it  is  a  period  of  relatively  perfect  health.  On  the  other  hand,  TOX  and  REL 
represent  periods  of  possibly  poorer  quality  of  life.  Therefore,  the  quality-adjusted 
outcome  can  be  formed  by 

Q-TWiST  =  uTOXx  TOX  +  TWiST  +uMLx  REL,  (2) 

where  u^  and  u^  are  the  utility  coefficients  for  TOX  and  REL,  respectively.  Figure  3 
illustrates  the  weighted  time  periods  according  to  assumed  utility  coefficients  of  1.0  for 
TWiST,  0.75  for  TOX  and  0.50  for  REL.  This  example  represents  a  scenario  in  which,  on 
average,  one  month  spent  in  TOX  would  be  exchanged  for  3  weeks  in  TWiST  and  one 
month  spent  in  REL  would  be  exchanged  for  2  weeks  in  TWiST. 
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Utility 
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Years 

Figure  3.  Components  of  Quality-adjusted  Time  Without  Symptoms  and  Toxicity  (Q- 
TWiST)  for  the  example  of  adjuvant  chemotherapy  for  breast  cancer.  The  division  of 
overall  survival  into  TOX  (subjective  toxic  effects),  TWiST,  and  REL  (relapse),  and  the 
weighting  of  these  time  periods  using  utility  coefficients  uTOX  and  uRFL  are  illustrated. 


6 


■'’b 


TWiST  is  considered  to  be  the  best  possible  clinical  health  state  for  the  particular  disease 
being  studied.  In  most  analyses  it  is  assigned  the  value  of  one  for  all  treatment  arms  In 
some  disease  settings,  however,  different  therapies  may  be  less  successful  in  returning 
patients  to  states  of  relatively  good  health  and  in  this  case  TWiST  may  be  assigned  a 
value  less  tnan  one. 

When  patient-derived  utility  values  are  not  available,  the  treatment  comparison  results 
are  best  presented  as  a  threshold  utility  analysis,  a  sensitivity  analysis  of  the  treatment 
comparison  ranging  over  all  possible  values  of  the  utility  coefficients.  A  threshold  line  is 
computed  by  equating  the  Q-TWiST  formula  for  the  two  treatments  (i.e.,  setting  O- 
TWiST  treatment  difference  equal  to  zero)  and  solving  for  uT0X  in  terms  of  Ur^.  Figure  4 

shows  the  threshold  utility  plot  for  the  Q-TWiST  treatment  comparison  based  on  the 
partitioned  survival  analyses  presented  in  Figure  2. 


Figure  4.  Threshold  utility  analysis  for  1,229 
patients  in  IBCSG  Trial  V.  The  vertical  axis 
shows  the  value  of  uTOX>  and  the  horizontal  axis 
shows  the  value  of  uREL.  Both  11^  and  uREL 
range  between  0  and  1,  where  the  value  1 
indicates  that  the  time  is  worth  the  same  as 
TWiST,  while  the  value  0  indicates  that  the  time 
is  worth  nothing.  The  solid  line  is  the  threshold 
(based  on  values  of  u^  and  u^)  for  which  the 
treatments  have  equal  Q-TWiST.  The  dashed  line 
shows  the  95%  confidence  band  for  the 
threshold.  The  region  denoted  by  "Longer 
Duration  Sig.  Better"  indicates  the  values  of 
utility  coefficients  for  which  average  Q-TWiST  at 
7  years  after  randomization  was  statistically 
significantly  greater  for  the  long  duration 
chemotherapy  treatment  compared  with  the  short 
duration  chemotherapy  treatment.18-^ 
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Q-TWiSTextensions  have  been  developed.  The  gain  function  describes 
y-iwiyr  treatment  differences  according  to  increasing  follow-up  time  and  enables 
extrapolation  of  results  using  parametric  models. 24,25  Prognostic  factors  can  be 
incorporated  in  Q-TWiST  analyses  using  Cox  proportional  hazards  models.26  Q-TWiST 
C5ln  ^so  performed  using  data  from  several  randomized  clinical 

trials.27-28 


In  addition  to  the  general  assumptions  for  QAS,  Q-TWiST  also  assumes  that  the  defined 
clinical  health  states  are  progressive.  The  Q-TWiST  model  described  in  equation  (2)  also 
assumes  that  health  state  scores  are  independent  from  treatment  assignment.  If  critical 
for  making  treatment  comparisons,  these  assumptions  may  be  satisfied  by  adding  more 
clinical  health  states  to  the  model.  This,  however,  increases  the  complexity  of  the 
analysis  and  makes  it  more  difficult  to  focus  on  fundamental  tradeoffs.  If  a  large  number 
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of  clinical  health  states  is  required  to  reasonably  describe  the  major  aspects  of  the 
disease  and  treatment  course,  or  if  these  health  states  are  not  necessarily  progressive, 
semi-Markov  models  can  be  used  to  estimate  the  health  state  durations  or  average 
sojourn  times.29  These  estimates  can  then  be  multiplied  by  utility  scores  to  obtain  a  QAS 
evaluation. 

Q-TWiST  has  most  frequently  been  criticized  for  using  arbitrary  utility  weights  rather 
than  incorporating  patient-derived  utilities.30  31  There  are  now  two  ongoing  clinical 
trials  which  are  collecting  utility  scores  to  be  used  in  a  Q-TWiST  analyses.  One  is  a 
comparison  of  surgical  techniques  for  the  removal  of  colon  tumors  and  employs  Q- 
tilities,32  a  multi-attribute  utility  theory  translation  from  Spitzer's  Quality-of-Life  Index. 
The  second  is  an  evaluation  of  therapeutic  regimens  for  childhood  acute  lymphoblastic 
leukemia  and  uses  the  McMaster  HUI2/3.3 

Q-TWiST  has  several  advantages  as  a  QAS  methodology.  Q-TWiST  can  be  applied  to 
previously  conducted  clinical  trials  to  provide  information  on  QOL  issues  even  without 

patient-derived  QOL  measures. _ Its  graphical  presentations  are  understandable  to 

clinicians  who  are  familiar  with  QGV^survival  curves.  The  method  works  with  censored 
data.  The  threshold  utility  plots  alloW  patients  to  identify  which  area  of  the  threshold 
plot  might  best  reflect  their  individual  situation  and  thereby  see  which  might  be  the 
treatment  preferred  with  regard  to  QOL.\ 


V.  Conclusions 

The  evaluation  of  treatment  effectiveness  in  terms  of  quality  of  life  is  becoming 
increasingly  important  in  clinical  trials.  For  chronic  illnesses  with  no  cure,  new 
treatments  will  need  to  be  evaluated  not  only  for  a  survival  effect,  but  also  for  possible 
palliative  advantages.  In  this  case  as  well,  quality-adjusted  survival  is  the  way  to 
incorporate  quality-of-life  considerations  into  the  usual  assessment  of  treatment 
comparisons  based  on  length  of  life. 

Some  have  argued  that  attempts  to  integrate  length  of  life  outcomes  and  quality-of-life 
data  are  misguided  and  fundamentally  wrong.33  It  is  claimed  that  QOL  and  length  of  life 
should  be  presented  as  multiple  end  points  to  allow  patients  and  physicians  to  combine 
these  outcomes  in  ways  that  are  meaningful  for  them.  We  believe  that  integrating 
quality  and  quantity  of  life  provides  more  information  than  either  outcome  alone, 
especially  if  the  results  are  presented  with  an  emphasis  on  sensitivity  analysis. 

If,  within  a  particular  treatment  comparison,  it  is  reasonable  to  define  progressive  clinical 
health  states,  then  a  Q-TWiST  analysis  can  be  performed  with  or  without  patient-derived 
utility  assessments.  If  such  assessments  are  available,  these  can  be  used  to  estimate 
plausible  values  for  the  Q-TWiST  utility  coefficients.  If  frequent  and  complete  serial 
assessments  are  available,  QALY  analysis  would  be  preferred. 
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VI.  Some  Questions  for  Discussion 


How  can  QAS  best  be  used  for  individual  patient  treatment  decisions?  What  graphical 
presentations  would  be  useful? 

For  cost-effectiveness  analysis,  QALY  generally  refers  to  expected  value  over  the  entire 
life  time.  Can  QALY  analyses  in  clinical  trials  have  meaning  if  restricted  to  specified 
follow-up  intervals? 

How  can  QALYs  be  estimated  from  clinical  trial  data  subject  to  censoring  and  missing 
observations? 

In  a  QALY  analysis  is  it  best  to  average  the  utilities  across  patients  or  across  assessment 
periods? 

What  are  the  pros  and  cons  of  conducting  quality-adjusted  survival  analyses  based  on 
clinical  health  state  durations  (i.e.,  Q-TWiST  analysis)? 

How  can  patient  derived  utilities  best  be  included  in  a  Q-TWiST  analysis? 
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Incorporating  Patients’  Preferences  in  the  Evaluation  of  Adjuvant  Therapies 

1.0  INTRODUCTION 

The  1990  update  of  the  Early  Breast  Cancer  Trialists’  Cooperative  Group  (EBCTCG)  overview  reported 
important  results  from  a  meta-analysis  of  all  randomized  clinical  trials  evaluating  adjuvant  therapies  for  breast 
cancer  patients'.  The  results  of  this  analysis  contributed  to  the  adoption  of  tamoxifen  as  the  standard  adjuvant 
therapy  for  postmenopausal  women.  The  addition  of  chemotherapy  to  tamoxifen  did  not  significantly  improve 
survival  for  those  patients  in  the  1990  overview.  Thus  an  advantage  for  using  adjuvant  chemotherapy  for 
postmenopausal  breast  cancer  patients  was  not  clearly  demonstrated.  The  next  update  of  the  overview  is  now 
underway,  and  the  results  are  scheduled  for  presentation  to  the  clinical  trialists  in  September,  1995.  These 
results  are  again  expected  to  have  a  profound  influence  on  breast  cancer  therapeutic  recommendations.  The 
proper  interpretation  of  the  1995  overview  update  will  require  evaluation  of  quantity  and  quality  of  life. 

The  primary  purpose  of  the  proposed  study  is  to  incorporate  patient  preferences  in  a  quality-adjusted 
survival  analysis,  Q-TWiST  (Quality-adjusted  Time  Without  Symptoms  of  disease  and  Toxicity  of  treatment), 
using  the  1995  overview  database  and  focusing  on  the  issue  of  chemotherapy  treatment  for  postmenopausal 
patients.  Specifically,  we  propose  to  address  the  tradeoff  between  increased  toxicity  associated  with 
chemotherapy  and  possible  benefits  in  terms  of  disease-free  and  overall  survival  in  an  effort  to  provide  a  guide 
for  treatment  decision  making. 

2.0  SPECIFIC  AIMS 

1)  To  perform  a  Q-TWiST  threshold  utility  analysis  on  the  1995  overview  database  designed  to  estimate  the 
quality-adjusted  survival  provided  by  adjuvant  chemotherapy  for  postmenopausal  women  with  breast  cancer. 

2)  To  perform  a  comprehensive  survey  comparing  five  methods  for  eliciting  patient-derived  preferences  and 
utilities  during  the  course  of  patients’  treatment  and  disease. 

3)  To  incorporate  patient-derived  preferences  in  Q-TWiST  analyses  in  order  to  assist  women  and  their 
physicians  with  interpretation  of  the  overview  results  based  on  considerations  of  quantity  and  quality  of  life. 

3.0  BACKGROUND  AND  SIGNIFICANCE 

The  1990  overview,  based  on  3932  patients  fifty  years  of  age  and  older,  reported  that  chemotherapy  added  to 
tamoxifen  did  not  significantly  improve  overall  survival,  although  there  was  some  evidence  suggesting  an 
improvement  in  disease-free  survival1.  The  absolute  benefit  in  overall  survival  was  estimated  to  be  less  than 
four  percent  at  ten  years  for  node-negative  patients  and  less  than  six  percent  at  ten  years  for  node-positive 
patients.  Therefore  the  use  of  adjuvant  chemotherapy  for  postmenopausal  breast  cancer  patients  has  remained 
controversial.  Based  on  the  positive  results  of  individual  studies  published  since  the  1990  report,  it  is  quite 
likely  that  the  1995  overview  update  will  show  a  statistically  significant,  but  clinically  modest  improvement  in 
overall  survival  with  the  addition  of  chemotherapy  to  tamoxifen.  This  outcome  would  heighten  the  debate 
concerning  whether  statistical  significance  in  this  setting  implies  clinical  significance  in  terms  of  the  usefulness 
of  chemotherapy  to  improve  net  patient  benefit.  The  use  of  chemotherapy  requires  consideration  of  the  tradeoffs 
between  the  potential  for  modest  gains  in  overall  survival  against  the  decrease  in  quality  of  life  (QOL).  Quality- 
adjusted  survival  analyses  of  chemotherapy  data,  such  as  Q-TWiST,  are  designed  to  highlight  these  tradeoffs 
A  quality-adjusted  survival  analysis  by  definition  requires  an  evaluation  of  patients’  QOL,  but  there  is 
disagreement  as  to  what  type  of  QOL  assessment  is  most  appropriate.  Although  some  investigators  believe  that 
QOL  scales  based  on  descriptive  health  state  measures,  such  as  the  Breast  Cancer  Chemotherapy  Questionnaire, 
are  valid  for  use  as  weights  in  calculating  quality-adjusted  survival,  the  dominant  view  is  that  the  health-state 
weights  should  be  based  on  preferences2.  These  preferences,  called  utilities,  are  measured  by  comparison  with 
an  external  metric,  such  as  time  or  risk.  Utilities  are  conventionally  measured  on  a  scale  from  0  to  1 ,  with  0 
representing  death  and  1,  perfect  health.  Utilities  are  appealing  measures  of  QOL  for  several  reasons.  They 
are  global  measures  reflecting  the  respondent’s  overall  health.  Also,  because  of  the  way  they  are  defined,  the 
product  of  a  utility  and  time  is  a  meaningful  number.  This  allows  the  calculation  of  quality-adjusted  life 
expectancy. 
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There  are  two  basic  approaches  to  utility  assessment:  direct,  holistic  utility  assessment  and  indirect 
weights.  In  the  holistic  approach,  patients  are  asked  a  time-tradeoff,  standard  gamble,  or  rating  scale  question 
to  determine  how  they  value  their  current  QOL.  A  time-tradeoff  question  asks  respondents  to  identify  the 
minimum  length  of  life  in  perfect  health  that  they  would  be  willing  to  accept  in  exchange  for  a  longer  length 
of  life  in  their  current  state  of  health.  The  ratio  of  these  two  life  expectancies  at  which  they  are  indifferent  is 
the  utility  for  the  respondents’  current  state  of  health.  A  standard  gamble  utility  is  the  probability  of  death  in 
a  gamble  between  excellent  health  and  death,  such  that  respondents  are  indifferent  between  the  gamble  and  their 
current  state  of  health.  There  are  practical  problems  in  using  these  measures,  such  as  the  difficulty  of 
administering  these  complex  questions  to  diverse  respondents  in  an  inexpensive  manner.  The  rating  scale  item, 
which  asks  patients  to  value  their  current  state  of  health  between  0  and  100,  is  easily  administered  in  the  clinical 
trial  setting,  but  has  questionable  theoretical  standing  as  a  utility  measure.  There  is  also  a  theoretical  debate 
about  the  ideal  timing  of  assessment.  Patients  who  are  currently  experiencing  the  health  state  are  most 
knowledgeable  about  QOL  in  that  state,  but  may  have  accommodated  to  the  disease  and  may  have  biases 
regarding  the  treatment  choice.  Respondents  who  have  not  yet  experienced  the  state  are  better  able  to  weigh 
one  hypothetical  outcome  against  another,  as  a  decision  maker  must,  but  may  not  fully  understand  the  disease 
experience. 

Indirect  weights  derived  from  health-state  classification  systems  offer  an  appealing  alternative.  One 
example  of  a  generic  system  for  which  preference  weights  have  been  obtained  is  the  Health  Utilities  Index 
(HUI),  developed  at  McMaster  University2.  Preference  weights  in  the  HUI  are  based  on  multi-attribute  utility 
theory  where  the  domains  of  the  classification  system  are  regarded  as  attributes  in  a  utility  function3.  Health 
status  domains  included  in  the  Mark  II/III  version  of  the  HUI  are  vision,  hearing,  speech,  emotion, 
pain/discomfort,  ambulation/mobility,  dexterity,  cognition,  self-care  and  fertility.  We  will  also  evaluate  a 
cancer-specific  classification  system,  the  Q-tility  Index,  developed  by  Drs.  Jane  Weeks  and  Milton  Weinstein4, 
and  based  on  the  five-item  Quality  of  Life  Index  designed  by  Dr.  Walter  Spitzer5.  As  in  the  HUI,  preference 
weights  for  the  Q-tility  Index  are  based  on  multi-attribute  utility  theory. 

Regardless  of  the  outcome  of  the  1995  overview  update,  the  issue  of  toxicity  associated  with 
chemotherapy  will  remain  a  major  consideration  for  patients  and  physicians  when  making  treatment  decisions 
for  postmenopausal  breast  cancer.  This  will  be  especially  true  if  the  overall  survival  advantage  for 
chemotherapy  is  modest.  In  this  case,  patients  and  physicians  will  still  be  left  with  the  major  question:  "Is  the 
survival  benefit  worth  the  side  effects  of  chemotherapy?"  This  question  can  only  be  answered  by  incorporating 
QOL  considerations  into  the  treatment  evaluation.  By  making  use  of  the  overview  data,  along  with  patient- 
derived  preference  data,  we  will  be  able  to  estimate  the  percent  of  patients  who  will  benefit  from  chemotherapy 
in  terms  of  quality-adjusted  survival  time  and  the  percent  of  patients  who  will  not.  We  believe  this  information 
will  be  critically  important  for  making  treatment  decisions. 

4.0  PRELIMINARY  STUDIES 

A.  Q-TWiST.  Drs.  Richard  Gelber,  Bernard  Cole,  and  colleagues  pioneered  the.  Q-TWiST  methodology, 
which  is  designed  to  highlight  tradeoffs  from  clinical  trials  incorporating  QOL  considerations  for  treatment 
decision  making6.  It  has  been  used  extensively  in  the  evaluation  of  adjuvant  therapies  for  operable  breast 
cancer.  In  this  setting,  the  benefits  associated  with  a  delay  in  the  time  to  recurrence  of  symptomatic  breast 
cancer  have  to  be  balanced  against  the  side  effects  of  treatment.  Q-TWiST  is  currently  being  applied  to  evaluate 
treatments  for  rectal  cancer,  colon  cancer,  melanoma,  myeloma,  childhood  acute  lymphoblastic  leukemia,  HIV 
infection,  and  multiple  sclerosis.  Q-TWiST  has  been  modified  for  use  in  meta-analyses  and  has  been  applied 
to  evaluate  data  from  the  1990  breast  cancer  overview7 .  We  will  use  this  innovative  methodology  in  the  current 
proposal. 

In  the  adjuvant  breast  cancer  setting  three  QOL-oriented  clinical  health  states  have  been  defined  to 
highlight  the  differences  between  the  regimens  being  compared.  These  are  time  spent  with  treatment  toxicity 
(TOX),  time  without  symptoms  of  the  disease  and  without  toxicity  of  treatment  (TWiST),  and  time  following 
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the  diagnosis  of  systemic  spread  of  the  disease  or  relapse  (REL).  TWiST  represents  a  period  of  relatively 
uncompromised  QOL  reflecting  the  best  QOL  available  for  the  study  patients  and  is  assigned  a  utility  weight 
of  one.  Utility  coefficients  assigned  to  the  other  two  clinical  health  states  reflect  the  average  values  of  time 
spent  in  each  state  relative  to  TWiST.  The  Q-TWiST  outcome  is  calculated  as  the  weighted  sum  of  the  clinical 
health  state  durations  and  the  utility  coefficients  according  to  the  following  equation:  Q-TWiST  =  uT0X  x  TOX 
+  TWiST  +  uREL  x  REL.  To  illustrate  the  method,  we  describe  a  Q-TWiST  analysis  of  chemotherapy  versus 
no  adjuvant  treatment  for  1229  premenopausal  patients  based  on  data  from  the  1990  overview.  The  clinical 
health  state  durations,  TOX,  TWiST,  and  REL  are  estimated  by  partitioning  the  overall  survival  time  of 
patients  assigned  to  the  treatment  options  being  compared.  Figure  1  shows  this  partitioning  of  overall  survival 
for  the  patients  in  the  chemotherapy  group7.  Areas  between  the  curves  provide  estimates  of  TOX,  TWiST,  and 
REL  which  are  substituted  into  the  equation  separately  for  each  treatment  group.  The  effectiveness  of 
chemotherapy  versus  no  chemotherapy  is  estimated  by  computing  differences  in  Q-TWiST  for  any  pair  of  values 
of  the  utility  coefficients.  The  influence  of  patient  preferences  on  treatment  choice  can  be  examined  by  a 


Months  from  Randomization 

Figure  1:  Partitioned  Survival  for  Chemotherapy  Group 


sensitivity  analysis,  called  a  threshold  utility  analysis  (see  Figure  2),  which  displays  treatment  comparisons  for 
varying  values  of  the  utility  coefficients*.  The  solid  line  represents  the  set  of  utility  coefficients  for  which  the 
treatment  groups  have  equal  Q-TWiST  after  60  months  of  median  follow-up.  The  area  above  the  solid  line 
represents  utility  coefficients  for  which  the  chemotherapy  group  has  more  Q-TWiST,  while  the  area  below  the 
solid  line  has  more  Q-TWiST  for  the  no  chemotherapy  group.  As  illustrated  in  Figure  2,  adjuvant 
chemotherapy  for  premenopausal  patients  is  better  than  no  chemotherapy  for  a  wide  range  of  utility  coefficients. 
To  date,  Q-TWiST  analyses  have  been  performed  using  threshold  utility  plots  to  define  the  range  of  utility 
coefficients  for  which  one  treatment  would  be  preferred  to  another  according  to  data  on  efficacy  obtained  from 
clinical  trials.  The  next  step,  to  be  provided  by  this  research  proposal,  is  to  obtain  and  incorporate  patient- 
derived  utility  coefficients  for  the  Q-TWiST  analysis. 

B.  Utility  Assessment.  Drs.  Weeks  and  Weinstein  have  been  developing  a  cancer-specific  multi-attribute 
utility  system,  the  "Q-tility  Index"4.  This  system  employs  the  Quality  of  Life  Index  (QLI)5  as  the  health  state 
classification  instrument.  The  QLI  is  a  brief  (5  item),  self-administered,  cancer-specific  QOL  questionnaire  that 
has  been  shown  to  provide  valid  and  reliable  assessments  of  QOL  in  all  stages  of  illness.  It  assesses  QOL  in 
five  domains  with  three  levels  of  functioning  in  each  domain:  work,  self-care,  general  health,  social  support 
and  outlook.  Therefore,  it  classifies  respondents  into  243  unique  health  states.  The  Q-tility  Index  represents 
a  mapping  formula  which  assigns  a  utility  to  each  of  those  243  states  reflecting  the  preference  weights  supplied 
by  a  reference  population.  In  contrast  to  the  HUI  which  used  a  general  population  as  the  reference  population. 
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relatives  (and  close  friends)  of  cancer  patients  were  selected  to  provide  preference  weights  for  the  Q-tility  Index 
Using  relatives  and  close  friends  of  cancer  patients  is  advantageous  because  these  individuals  are  more 
knowledgeable  than  members  of  the  general  population  about  cancer  treatment  and  recovery,  yet  are  still  in  a 
position  to  provide  weights  necessary  to  generate  comparative  ratings  of  a  variety  of  hypothetical  health  states 
as  required  in  the  multi-attribute  approach.  The  ability  of  this  model  to  predict  elicited  utilities  for  composite 
states  among  respondents  represents  a  significant  improvement  over  the  prior  work  in  this  field3. 

A  recent  study9  compared  the  Q-tility  score  to  a  holistic  utility  derived  from  a  time-tradeoff  question. 
An  in-person,  interviewer-administered  time-tradeoff  question  using  visual  aids  resulted  in  a  relatively  high  rate 
of  respondent  confusion  despite  ideal  conditions.  This  study  confirmed  anecdotal  data  suggesting  that  these 
measures  are  not  practical  for  use  in  clinical  trial  or  population  survey  settings.  The  current  proposal  will 
survey  postmenopausal  breast  cancer  patients  to  ascertain  patient-derived  utilities  for  use  in  the  proposed  Q- 
TWiST  analysis  and  to  establish  recommended  procedures  for  eliciting  patient  preferences  for  future  clinical 
situations. 

5.0  RESEARCH  DESIGN  AND  METHODS 

Efficacy  Data:  The  proposed  study  will  use  data  from  the  EBCTCG  1995  overview  of  all  randomized  clinical 
trials  on  disease-free  survival  and  overall  survival  of  postmenopausal  breast  cancer  patients  (50  years  of  age  and 
older)  who  were  enrolled  in  trials  comparing  chemotherapy  plus  tamoxifen  versus  tamoxifen  alone.  In  addition, 
individual  patient  covariates  will  be  available  to  stratify  the  analysis  according  to  age,  estrogen  receptor  status, 
and  nodal  status.  Dr.  Gelber  has  been  an  active  participant  in  the  breast  cancer  overview  collaboration  since 
1984.  He  has  obtained  permission  from  the  EBCTCG  to  conduct  Q-TWiST  analyses. 

Survey  Patient  Population:  A  cross-sectional,  convenience  sample  of  postmenopausal  breast  cancer  patients 
at  the  Dana-Farber  Cancer  Institute  (DFCI)  who  are  at  various  points  during  the  course  of  their  disease  and 
treatment  will  be  surveyed  to  elicit  utilities.  Potentially  eligible  postmenopausal  breast  cancer  patients  will  be 
identified  by  study  personnel  using  the  DFCI’s  Clinical  Research  Information  System,  a  comprehensive  database 
of  longitudinal  clinical  information  maintained  on  all  breast  cancer  patients.  The  study  protocol  will  be 
submitted  for  approval  by  the  DFCI  Human  Protection  Committee.  A  letter  describing  the  study  will  be  sent 
to  eligible  patients  prior  to  a  scheduled  clinic  visit.  Patients  who  do  not  wish  to  participate  will  be  asked  to 
return  an  enclosed  self-addressed  postcard.  All  other  patients  will  be  approached  for  consent  at  their  clinic  visit. 

Survey  Data  Collection:  Patient  data  will  be  collected  by  interview  after  informed  consent  has  been  obtained. 
The  QOL  information  collected  in  patient  interviews  will  consist  of  the  following:  a  standard  gamble  utility 
question,  a  time-tradeoff  utility  question,  a  0-100  rating  scale  question,  the  Mark  U/HI  version  of  the  HUI,  the 
5-item  Quality  of  Life  Index,  and  sociodemographic  information.  Interviews  will  be  conducted  by  a  trained 
interviewer  on  the  study  staff,  in  private,  in  a  room  adjacent  to  the  clinic.  In  addition,  data  on  disease  status 
at  the  time  of  the  interview  and  treatment  history  will  be  obtained  from  the  DFCI  Clinical  Research  Information 
System. 

Analytic  Plan  for  Aim  1:  Quality-adjusted  survival  will  be  computed  using  the  following  formula:  Q-TWiST 
=  utox  x  TOX  +  TWiST  +  u^  x  REL,  where  the  utility  weight  for  TWiST  is  set  to  one  and  the  coefficients, 
uTOX  and  u^,  hold  places  for  the  values  of  the  respective  clinical  health  states  relative  to  TWiST.  The  second 
term  of  each  product  is  the  length  of  time  spent  in  each  clinical  health  state.  Mean  durations  for  the  clinical 
health  states  will  be  computed  according  to  treatment  group  based  on  data  from  the  overview.  Information  on 
duration  of  toxicity,  time  to  disease  progression  and  time  to  death  will  be  used.  A  threshold  utility  analysis  will 
be  performed  to  illustrate  the  preferred  treatment  for  all  pairs  of  utility  coefficients.  Patient  preference  data  will 
not  be  used  in  this  analysis.  Subgroup  analyses  based  on  age,  nodal  status  and  estrogen  receptor  status  will  be 
performed  to  explore  the  influence  of  these  factors  on  treatment  outcome. 
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Analytic  Plan  for  Aim  2:  The  goal  of  this  portion  of  the  analysis  is  to  estimate  the  differences  among  the  five 
preference  measurements:  the  standard  gamble,  time  tradeoff,  0  to  100  rating  scale,  Q-tility  Index,  and  the 
HUI.  A  pilot  study  (n=  124)  suggested  that  the  standard  deviation  of  the  paired  differences  between  the  time- 
tradeoff  question  and  rating  scale  item  (both  rescaled  to  a  range  of  0  to  1)  is  0.26.  Adjusting  for  multiple 
comparisons  using  Scheffe’s  method  (10  pairwise  comparisons  among  the  5  estimates)  the  95%  confidence 
intervals  for  mean  difference  between  any  two  measures  will  have  a  half-width  equal  to  (2.6  x  0.26)  /  sqrt(n). 
A  total  of  183  surveys  will  be  required  to  provide  95%  confidence  intervals  with  half-widths  less  than  0.05. 
Based  on  the  census  of  newly  diagnosed  and  follow-up  cases  at  DFCI,  over  300  patients  will  be  eligible  for 
study  during  the  eight  month  recruitment  period,  and  at  least  200  are  anticipated  to  participate. 

Analytic  Plan  for  Aim  3:  Each  patient  in  the  survey  will  be  classified  into  one  of  the  three  Q-TWiST  clinical 
health  states  (TOX,  TWiST,  and  REL)  using  information  on  disease  and  treatment  status.  To  estimate  utility 
coefficients  for  these  states,  we  will  average  the  utility  estimates  separately  from  each  of  the  five  patient-derived 
preference  measures.  These  average  utility  values  will  be  used  to  obtain  five  point  estimates  for  Q-TWiST 
evaluations  of  chemotherapy  versus  no  chemotherapy  from  DFCI  patients  according  to  the  following  formula: 
Q-TWiST  =  uT0X  x  TOX  +  uWCT  x  TWiST  +  u^  x  REL.  The  preference  measures’  influence  on  the  Q- 
TWiST  point  estimate  will  be  evaluated.  The  variability  of  patient  preferences  will  also  be  used  to  evaluate  the 
range  of  preferred  treatment  choices  based  on  the  Q-TWiST  threshold  plot  obtained  from  Specific  Aim  1.  The 
threshold  utility  plot  will  be  divided  into  a  grid  and  the  patient  preference  data  will  be  used  to  define  the 
proportion  of  patients  falling  into  each  region  of  the  grid.  This  will  indicate  the  most  prevalent  treatment 
selections  based  on  DFCI  patient  preferences. 

Timetable  for  Investigation 

The  study  will  be  completed  in  one  year.  During  the  first  two  months  of  the  project,  we  will  obtain  data  from 
the  meta-analysis  of  the  1995  EBCTCG  overview  and  design  the  survey  instrument  and  protocol.  All  primary 
data  collection  of  patient  preference  estimates  will  take  place  during  months  3  to  10  of  the  project.  Data 
analysis  will  take  place  over  the  final  two  months  of  the  project.  During  the  last  month  of  the  project,  we  will 
prepare  the  final  report  as  well  as  manuscripts  for  publication. 
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a  purpose 

Adjuvant  chemotherapy  for  early  breast  cancer  has 
been  shown  to  offer  an  improvement  in  recurrence- 
free  and  overall  survival,  especially  for  younger 
women,  but  the  acute  toxic  effects  of  this  treatment 
discourage  some  physicians  from  prescribing  it.  The 
purpose  of  this  analysis  was  to  determine  whether  the 
benefit  of  6  months  of  adjuvant  CMF  (cyclophos¬ 
phamide,  methotrexate,  fluorouracil)  treatment  out¬ 
weighs  its  costs  in  terms  of  toxic  effects, 

■  METHODS 

A  meta- analysis  of  quality- adjusted  survival  was  per¬ 
formed  based  on  data  from  1229  patients,  aged  49 
years  or  younger,  randomized  in  eight  trials  compar¬ 
ing  CMP  versus  no  adjuvant  systemic  therapy.  The 
eight  trials  were  included  in  the  worldwide  overview 
conducted  by  the  Early  Breast  Cancer  Trialists5 
Collaborative  Group,  The  Q-TWiST  method  was 
used  in  a  meta-analysis  that  provided  treatment  com¬ 
parisons  incorporating  differences  m  quality  of  life 
associated  with  the  amount  of  time  patients  spend 
with  subjective  toxic  effects,  after  relapse,  and  with¬ 
out  symptoms  of  relapse. 

a  RESULTS 

Within  6  years  of  follow-up  evaluation  for  patients 
with  node-positive  disease,  the  benefit  in  terms  of 

Adjuvant  chanotherapy  has  been  shown  to  increase 
survival  and  relapse- free  survival  for  parienes  with 
resectable  brass  cancer,  especially  for  women  49  years  of 
age  or  less.1  For  dlis  age  group  the  effects  of  ovarian  abla- 
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increased  relapse-free  and  overall  survival  balanced 
the  costs  in  terms  of  acute  toxic  side  effects.  This  was 
true  even  for  the  extreme  case  in  which  a  zero  value 
was  assigned  to  all  6  months  during  which  patients 
might  receive  adjuvant  CMF  chemotherapy.  Within 
10  years  of  follow-up  evaluation,  treated  paiients 
gained  ah  average  of  1.5  years  of  relapse-free  survival 
time,  almost  1  year  of  overall  survival  rime,  and  \ 
year  of  rime  without  symptoms  and  toxicity. 

a  conclusions 

Adjuvant  chemotherapy  for  younger  women  with 
node-positive  breast  cancer  provided  substantial 
amounts  of  quality-adjusted  survival  time,  even  after 
accounting  for  costs  associated  with  toxic  effects  of 
the  treatment-  The  Q-TWiST  method  represents  a 
valuable  tool  for  comparing  treatments  because  it 
incorporates  patients*  perceptions  of  their  quality  of 
life  for  therapeutic  decision-making.  (Cancer  J  Sc: 
Am  1995 ;  1:114-121) 


Keywords:  Breed  cancan  adjuvant  efceraasherasry, 
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non  and  of  tamoxifen  are  similar  to  that  of  poly- 
chemotherapy  when  indirect  comparisons  are  made 
using  the  Early  Breast  Cancer  Trial  ists'  Collaborative 
Group  (EBCTCG)  overview  data.  In  fra,  estimated 
typical  reductions  in  die  annual  odds  of  relapse  or  prior 
death  (±  SD)  were  37%  (±  5)  for  polychemo therapy  ver¬ 
sus  no  adjuvant  sysremic  therapy,  30%  (±  9)  for  ovarian 
ablation  versus  no  adjuvant  systemic  therapy,  and  27% 
(t  7)  for  tamoxifen  versus  no  adjuvant  systemic  therapy 
The  corresponding  estimated  typical  reductions  in  the 
annual  odds  of  death  from  any  cause  (±  SD)  were  27% 
(±  6),  28%  (x  9),  and  17  %  (±  10),  respectively. 

The  many  physicians  who  use  indirect  compar¬ 
isons  in  order  to  select  treatment  for  patients  condemn 

For  related  commentary,  see  page  101 
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chemotherapy  because  of  quaJity-of-life  considerations 
plating  co  its  early  adverse  side  effects.  For  these  physi¬ 
cians*  endocrine  therapies  also  reduce  relapse  and  death 

therefore  represent  preferred  therapeutic  options. 

No  direct  comparison  data  exist  to  solve  the  con¬ 
troversy  concerning  which  treatment  is  "the  best”  from 
among  the  rhree  modalities  available  for  younger 
women.  Although  some  clinical  trials  arc  being  con¬ 
duced  currendv  uo  provide  such  data,  this  is  not  likely 
ro  be  a  worthwhile  endeavor:  instead,  efforts  should  be 
made  to  improve  upon  ail  results. 

This  continuing  controversy,  even  for  the  subgroup 
of*  patients  for  whom  chemotherapy  has  been  proven 
ro  be  the  most  effective,  motivated  us  to  develop  a  tool 
lor  a  cost  and  benefit  analysis  of  relevance  to  the 
patienc.  Our  ev^luadon  of  chemotherapy  effectiveness 
in  premenopausal  patients  was  based  on  a  meta-analy¬ 
sis  of  quality-adjusted  survival. 

We  analyzed  data  from  ail  no  adjuvant  systemic 
treatment-controlled  trials  of  CMF  (cyclophos¬ 
phamide,  methotrexate,  fluorouracil)  polychemothera¬ 
py  Included  in  the  EBCTCG  overview  update.  CMF 
was  the  most  frequendy  assessed  specific  chemotherapy 
regimen.  All  trials  included  started  before  1985. 
Treatment  effects  were  estimated  exclusively  for 
parients  aged  49  years  or  younger.  We  provided  an 
additional  type  of  analysis  that  incorporated  aspects  of 
quality  of  life  into  the  treatment  comparison, 

h  MATERIALS  AND  METHODS 

All  data  were  obtained  from  the  EBCTCG  secre¬ 
tariat  with  permission  of  the  individual  triaiists.  The 
EBCTCG  records  were  used  to  identify  all  randomized 
clinical  trials  that  were  included  in  the  EBCTCG 
overview  update1  and  that  compared  CMF  versus  no 
adjuvant  systemic  treatment  in  women  aged  49  years 
or  younger.  From  the  identified  trials,  we  obtained 
patient-level  data  for  all  patients  meeting  the  eligibility 
criteria  of  the  EBCTCG  overview.  The  data  from  cadi 
patient  included  the  following  variables:  treatment, 
rime  to  relapse,  and  rime  to  death  or  censoring.  Hie 
data  collection,  and  quality  control  checks  are  described 
in  the  publication  of  the  overview  results. 

The  Quality- adjusted  Time  Without  Symptoms 
and  Toxicity  (Q-TWIST)  method2*4  was  used  to  ana¬ 
lyze  each  trial  individually.  The  individual  Q-TWIST 
results  were  then  combined  using  a  mcta-analysis 
methodology5  in  order  co  produce  overall  summary 
results.  The  Q-TWIST  methodology  used  in  this 
paper  to  analyze  the  individual  trials  has  been  previous¬ 
ly  described2-*  and  used  ro  evaluate  treatments  for 
breast  cancer.6  A  brief  overview  of  the  three  steps 
involved  is  given  here. 

Step  1 

A  series  of  clinical  end-points  were  defined,  which 
corresponded  co  transitions  beeween  states  of  health 
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Table  1,  Q-TWIST  Meta-Analysis  Trials 


Trial  Nam© 

Treatment  Comparison 

Patient  Population 

INT  Milan  72051*-'3 

12  CMF  v$,  nil 

N+ 

Manchester  l20-^ 

12  CMF  vs.  nil 

N+ 

DBCG  77B22-2* 

12  CMF  ♦  RT  vS.  RT 

N*  or  T>50mm 

Glasgow2528 

12  CMF  +  RT  vs.  RT 

N-b 

EORTC  09771 27 

24  CMF  vs,  nil 

N+ 

Guy's/Manch.  ]|28~3o 

12  CMF  vs.  nil 

N+ 

INT  Milan  800431.38 

12  CMF  vs,  nil 

N-;  ER" 

UK/Asia  Coiiat),33 

24  CMF  vs.  nil 

Nv 

Acer  aviations:  n,  nodal  sTauts;  T,  rumor:  ER,  estrogen  receptor:  RT„  radiation  therapy: 
CMF,  combined  chemotherapy, 


during  the  course  of  follow-up  evaluation  for  individ¬ 
ual  padents.  TOX  w as  defined  as  the  time  from  ran¬ 
domization  until  the  end  of  treatment  toxicity,  any 
relapse,  or  death,  whichever  occurred  first;  RFS  was 
defined  as  the  rime  to  any  relapse  or  death,  whichever 
occurred  first;  and  OS  was  defined  as  the  time  co  death 
from  any  cause.  The  clinical  health  states  correspond¬ 
ing  to  these  end-points  were:  (1)  time  spent  with  sub¬ 
jective  toxic  effects  of  treatment  (TOX),  (2)  rime  with¬ 
out  symptoms  of  disease  relapse  or  toxicity  of  treat¬ 
ment  (TWIST  =  RFS  -  TOX).  and  (3)  rime  following 
disease  relapse  (REL  =  OS  -  RFS), 

Step  2. 

The  clinical  trial  data  were  used  to  estimate  the 
mean  dorado n  of  each  health  stare  according  to  treat¬ 
ment  group.  For  the  health  state  TOX,  individual 
patient  levd  data  on  the  duration  of  toxicity  were  not 
available.  As  a  surrogate,  we  used  6  months  as  the  mean 
TOX  duration  for  the  chemotherapy  arm  of  each  trial. 

Table  2.  Sample  Sizes,  Relapses  and  Deaths  For  Trials 
in  the  O-TWIST  Meta-Analysis 


No,  of 

No.  of  Patients  Retepsga/Deaths  Noa  of  Domna 
Trial  Nam®  Chcmo  Control  Chomo  Control  Chemo  Control 


INT  Milan  7205 

95 

75 

57 

55 

46 

48 

Manchester  1 

21 

24 

15 

15 

12 

12 

DBCG  773 

149 

130 

69 

79 

60 

69 

Glasgow 

45 

35 

23 

24 

22 

23 

EORTC  09771 

98 

95 

50 

52 

34 

38 

Guy's/Mancfi.  II 

S6 

93 

37 

71 

26 

54 

INT  Milan  8004 

28 

29 

4 

12 

3 

9 

UK/Asia  CoiiaD. 

129 

97 

46 

47 

29 

22 

Toial 

651 

578 

301 

355 

232 

275 

Abbreviation;  Cbemo,  chemomerapy. 
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Table  3.  Individual  Q-TWiST  Results 

Treatment  Dlffarencea3 


Median 


Trial  Nam© 

Follow-up 

TOX 

twist 

REL 

OS 

RFS 

Q-TW1ST& 

INT  Milan  7204 

174 

a 

23 

•11 

18 

29 

20.(2-38) 

Manchester  1 

132 

6 

*4 

-3 

-1 

-2 

-3(-28  -  22) 

DBCG  770 

112 

8 

8 

-9 

5 

14 

7  (-3 -17) 

Glasgow 

109 

6 

13 

■2 

17 

19 

15  (-3  -33) 

EORTC  09771 

99 

6 

2 

•2 

6 

8 

4  (-4- 12) 

Guy's/Manch.  J1 

86 

6 

22 

•11 

17 

28 

20(12-28) 

INT  Milan  8004 

63 

6 

8 

-7 

7 

14 

7  (-3- 17) 

UK/Asia  Collab. 

49 

6 

-1 

-4 

2 

5 

0(-4  -  4) 

aMean  differences  in  monffis  {chemotheraoy  grcuo  minus  control  group)  for  me  components  of  G-TWjST  restricted  to  follow-up  times  lor  me 
individual  trials. 

DQ-TWiST  differences  are  given  for  trie  arbitrary  utility  values  of  tffgx  =  «  0,$,  with  95%  C.J.  in  parentfieses. 

Abbreviations;  TOX,  time  spent  with  adverse  side  effects  due  to  chemotherapy:  TWIST,  time  without  symptoms  of  relapse  and  toxicity  of  treat¬ 
ment;  REL  time  following  disease  relapse;  OS.  overall  survival;  RFS,  reiapse-free  survival;  Q-TWiST,  quality-adjusted  TWiST. 


A 


Months  from  Randomization 


6 


Months  from  Randomization 


Figure  1  (A)  Relapse-fre©  survival  and  (B)  overall  survival  for  the  entire 
1229-patient  sample  according  to  treatment  group  (dashed  line,  control 
group:  solid  line,  chemotherapy  group). 


Although  the  trials  tested  12  of  24  months  of  CMF,  6 
months  is  today’s  standard  duration,  and  has  been 
shown  to  be  equivalent  to  longer  durations.7'8  For  the 
control  arm,  no  toxidey  was  assumed  (i.c.,  TOX  «  0). 
For  the  end-points  RFS  and  OS,  the  Kaplan-Meier 
product  limit  method9  was  used  to  estimate  the  respec¬ 
tive  transitional  survival  curves  according  to  treatment 
group.  The  areas  between  these  curves,  restricted  to  the 
median  follow-up  duration  of  the  trial,  represented  the 
estimated  mean  duration  of  each  of  the  clinical  health 
states  (for  example,  see  Fig.  2). 

Step  3 

Utility  axffidencs  were  introduced  to  reflect  each 
health  states  quality-of-life  value  relative  to  time  in 
TWIST  The  utility  coefficient  scales  range  from  0  to 
1,  where  0  represents  a  stare  as  bad  as  death,  1  repre¬ 
sents  a  state  as  good  as  TWIST,  and  values  between  0 
and  1  represent  degrees  between  these  extremes.  Mean 
quality-adjusted  survival  (Q-TWiST)  for  each  treat¬ 
ment  arm  was  then  calculated  from  the  mean  clinical 
health  stare  durations  as  follows: 

Q-TWiST=  arc*  x  TOX  +  TWIST  +  u^x  REL 

where  TOX,  TWIST,  and  REL  represent  the  mean 
health  stare  durations,  and  s^-ox  and  u ^  denote  the 
utility  coefficients  for  the  states  TOX  and  REL,  respec¬ 
tively.  Q-TWiST  treatment  comparisons  were  made 
by  subtracting  the  estimated  mean  for  the  control 
group  from  the  estimated  mean  for  the  CMF- treated 
group.  Variance  estimates  for  the  health  state  durations 
and  Q-TWiST  were  also  obtained  The  utility  coeffi¬ 
cients  used  in  this  analysis  were  not  estimated  from 
patient-derived  data,  nor  were  they  assumed  to  be  any 
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particular  set  of  values.  Instead,  the  final  results  are  dis-  ^ 

played  as  a  sensitivity  analysis  over  she  Bill  range  of 

utility  coefficient  values  between  0  and  1.  This  is  illcd 

a  threshold  utility  analysis.-*  80 '  V'" 

Once  chese  three  steps  were  performed  for  each  of 
the  individual  trials,  the  results  were  combined  in  a  60* 

meta-analvsis  to  provide  overall  estimates  of  quality-  §2 
adjusred  survival.  The  technical  derails  of  the  mera-  40* 

analysis  methodology  are  reported  elsewhere5;  however,  t\n\$T 

we  give  a  brief  description  here.  The  individual  trial  20- 

results  were  combined  using  regression  models.  The 

dependent  variables  were  mean  RFS  and  mean  OS,  0*^“ — i - * - 

and  the  independent  variable  was  median  follow-up  0  12  24  3 

duration.  This  allowed  the  meta-analysis  to  accommo  Men 

date  the  varying  median  follow-up  intervals  among  the 
trials.  The  regression  parameters  were  estimated  by  B 
generalized  least  squares10  in  order  to  weight  the  trials  ^ 
according  co  their  respective  variance  estimates.  §2 

Scparare  regression  models  were  estimated  for  each  :S 

creacmenc  group.  60..;| 

The  estimated  regression  models  were  then  used  to  |§ 

predict  the  mean  clinical  health  state  durarions  for  fbl-  4Q . 

low-up  durations  of  60  and  120  months.  Covariation  -M  mwiST 

among  these  estimates  was  also  derived  from  the  20 -  H 

regression  model.  The  regression  analyses  were  per-  |3 

formed  separately  for  each  treatment  group.  The  q  TQX 

results  were  subsrituted  into  the  above  equation  for  Q-  0  12  24  3 

TWIST,  and  the  Q-TWiST  creacment  diflerence  was  ^0f 

determined  for  all  possible  values  of  the  unknown  util¬ 
ity  coefficients  in  a  threshold  utility  analysis. 

The  threshold  utility  analysis  consisted  of  deter-  Figure  2  Partitioned  aurvt 
mining  ail  paiis  of  utility  oeffidnivalm  for  which 

the  rwo  treatments  had  equal  Q-TwtST  (:.e„  the  me  follow-up  interval.  TO* 
treatment  difference  was  zero).  This  provided  a  thresh-  affects  due  to  chemctherai 
old  line  which  separated  the  range  of  possible  utility  symptoms  of  relapse;  REL 

Table  4.  Overall  Means  in  Months  for  the  Components  of  Q-7WIST3 


4  R£L  iv-S?- 


24  36  43  60  72  84  96 
Months  from  Randomization 


108  120  132 


24  36  43  60  72  84  96  108  120  132 
Months  from  Randomization 


Flgur®  2  Partitioned  survival  curves  for  tha  entire,  1229-patient  sample 
according  to  treatment  greupi  (A)  control  and  (B)  chemotherapy.  Areas 
between  the  curves  correspond  to  the  mean  health-state  durations  within 
the  follow-up  interval.  TOX  corresponds  to  time  spent  with  adverse  side 
affects  due  to  chemotherapy;  TWiST  denotes  time  spent  without  toxicity  and 
symptoms  of  relapse;  REL  denotes  the  time  following  disease  relapse. 


G-TWIST 

ei=0'S 


aMeta-anaiysis  results  for  follow-up  durations  of  SO  and  120  months;  standard  errors  for  trio  treatment  differences  appear  in  parentheses, 
treatment  difference  is  sigmtlcancy  oirrarant  from  zero  (P<  0,05), 

Abbreviations;  TOX,  time  spent  with  adverse  side  effects  due  to  chemtherapy;  TWiST,  time  without  symptoms  of  relapse  and  toxicity  0?  treat¬ 
ment;  R£l,  time  following  disease  relapse;  OS,  overall  survival;  RFS,  relao5©-free  survival;  Q-TWIST,  quaiity-ed  justed  TWIST. 
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Figure  3  “Threshold  utility  plots  for  (A)  60  months  and  (B)  120  months.  The 
solid  line  in  Fig.  A  indicates  pairs  of  utility  coefficient  values  for  which  the 
two  treatments  have  equal  Q-TWIST.  The  dashed  lines  are  upper  95%  con« 
fidence  limits  for  the  threshold  line. 

coefficient  pairs  into  two  regions.  These  regions  corre¬ 
sponded  to  pairs  of  utiliry  values  for  which  the 
chemotherapy  group  provided  more  Q-TWj ST  than  the 
control  group  and  vice  versa.  Ninety-five  percent  confi¬ 
dence  Limns  for  the  threshold  line  were  also  computed 
(for  example,  sec  Fig  3)> 

■  RESULTS 

A  total  of  eight  clinical  trials  that  compared  CMF 
versus  no  adjuvant  systemic  therapy  in  women  under 
50  years  of  age  were  found  in  the  EBCTCG  database 
(1229  patients  in  tocal).  Tabic  1  describes  the  treat¬ 
ment  comparison  and  patient  population  for  each  trial* 
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and  Table  2  gives  the  number  of  patients  randomized 
co  each  ereaumenc  group  as  well  as  the  number  of 
relapses  and  deaths  on  each  treatment:  arm.  Relapse- 
free  Survival  and  overall  survival  are  shown  in  Figure  1 
for  the  enure  1229  patient  sample. 

Table  3  shows  the  results  of  the  individual  Q- 
TWiST  treatment  comparisons  performed  on  each 
clinical  trial.  The  treatment  effect  (i.e.,  the  mean  for 
the  chemotherapy  group  minus  the  mean  for  the  con¬ 
trol  group)  is  shown  for  each  of  the  components  of  Q- 
WiST:  RFS,  OS,  WIST  and  R£L  as  well  as  for  Q- 
TWIST  with  the  arbitrary  utility  values  of  ^ox  = 

=  0.5.  These  values  were  selected  to  ill  us  trace  che  range 
of  Q-TWiST  results  across  che  trials  and  do  not  repre¬ 
sent  patient-derived  estimates.  Using  these  values,  the 
Q-TWiST  treatment  effects  for  chemotherapy  com¬ 
pared  with  no  adjuvant  therapy  ranged  from  -3 
months  to  +20  months.  These  results  describe  che 
mean  amount  of  time  gained  for  the  chemotherapy 
group,  up  to  a  maximum  determined  by  the  median 
follow-up  duration,  for  each  of  the  Q-TWIST  compo¬ 
nents.  The  median  follow-up  duration  for  each  clinical 
trial  is  also  shown  in  Table  3,  These  follow-up  intervals 
ranged  from  49  months  to  174  months. 

Table  4  presents  the  estimated  means  for  che  com¬ 
ponents  of  Q-TWiST  corresponding  to  median  fol¬ 
low-up  durations  of  60  months  and  120  months  based 
on  the  meta-analysis.  The  treatment  effect  (chemother¬ 
apy  group  minus  control  group)  is  also  given  for  each 
component  as  well  as  QTWiST  with  the  arbitrary 
utility  coefficient  values  of  =  —  0- 5 -  The  data 

in  Table  4  demons  race  that  within  10  years,  almost  l 
year  of  overall  survival  and  1.5  yean  of  relapse-free  sur¬ 
vival  can  be  gained  by  treated  patients  compared  co 
controls. 

Based  on  these  results,  the  chemotherapy  treat¬ 
ment  provides  more  time  in  each  of  the  clinical  health 
states  TOX  and  TWST,  bur  less  time  in  REL.  This  is 
due  to  the  larger  effect  that  chemotherapy  has  on  RFS 
than  on  OS,  The  treatment  rends  to  delay  the  time  to 
disease  relapse  more  than  it  delays  che  time  to  death. 
Therefore,  patients  undergoing  chemotherapy  spend 
on  average  less  time  in  REL  as  compared  co  patients 
receiving  no  adjuvant  systemic  therapy  (Fig.  2). 

Figure  3  displays  threshold  utility  analyses  based  on 
the  meta-analysis  for  follow-up  durations  of  60 
months  and  120  frionths.  In  the  60-month,  plot,  the 
solid  line  indicates  pairs  of  utility  coefficient  values  for 
which  the  two  treatments  have  equal  Q-TWiST.  For 
pairs  that  lie  below  this  threshold  line,  the  chemothera¬ 
py  treatment  provided  less  Q-TWIST  than  the  con¬ 
trol  Conversely,  for  pairs  above  the  threshold  line,  the 
chemotherapy  treatment  provided  more  Q-TWiST 
than  che  control.  The  dashed  line  is  an  upper  95% 
confidence  limit  for  the  threshold  line.  For  pairs  of 
utility  coefficient  values  chat  lie  above  the  dashed  line, 
che  chemotherapy  treatment  provided  significantly 
more  Q-TWiST  chan  the  control,.  In  the  120-month 


analysis.  the  chemotherapy  treatment  provided  more 
Q-PWST  chan  the  concrol  for  ad]  pairs  of  utility  coef¬ 
ficient  values  (i.e.,  no  threshold  line  appears  on  the 
plot).  Both  analyses  indicare  that  che  chemotherapy 
treatment  provides  significantly  more  quality-adjusted 
survival  rime  for  a  wide  range  of  ucilicy  coefficient 
pairs.  For  example,  parienrs  who  place  a  fairly  hfoh 
value  on  time  with  treatment  toxicity  (^ox  =  Q*&)  and 
a  lower  value  on  time  with  disease  relapse  (^L  =  Q.6) 
can  expect  a  benchc  from  chemotherapy  in  terms  of 
quality-adjusted  survival.  The  larger  region  above  the 
95%  confidence  limit  in  the  1 20-month  analysis  as 
compared  to  the  60-month  analysis  is  due  to  che 
longer  median  follow-up  time  chosen  and  che  long¬ 
term  benefits  of.  chemotherapy.  As  che  median  follow¬ 
up  time  increases,  we  observe  the  longer-term  benefits 
of  chemotherapy,  and  these  longer-term  benefits  pro¬ 
vide  additional  compensation  for  che  initial  6  months 
of  toxicity 

This  effect  is  also  Illustrated  by  the  Q-TWIST  gain 
function  shown  in  Figure  4.  This  diagram  illustrates 
the  predicted  monchs  gained  for  che  chemotherapy 
group  according  to  follow-up  duration  based  on  the 
meta- analysis.  The  dark  line  within  the  shaded  region 
corresponds  to  Q-TWiST  with  u^ox  -  =  0.5.  As 

follow-up  time  increases,  the  gains  for  the  chemothera¬ 
py  g^p  associated  with  delayed  relapse  and  improved 
survival  become  apparent.  The  shaded  region  in  che 
graph  represents  che  range  of  possible  gains  as  the  uciH- 
ty  coefficients  range  from  zero  to  one.  Initially,  che  gain 
in  Q-TWiST  for  che  chemotherapy  group  is  negative 
because  of  the  toxicity  experienced  early  in  follow-up. 
For  short  follow-up  durations  (of  20  monchs  or  less), 
the  benefits  of  chemotherapy  have  noc  had  sufficient 
time  ro  compensate  for  the  diminished  quality  of  life 
associated  with  initial  toxicity. 

d  DISCUSSION 

There  is  no  doubt  that  adjuvant  chemotherapy  for 
younger  padenis  has  a  major  effect  on  the  disease  and 
is  useful  for  patient  management.  But  since  che  contro¬ 
versy  raised  by  many  concerning  'which  adjuvant  ther¬ 
apy  is  che  bese 1  will  probably  continue  into  the  future, 
it  will  be  important  to  provide  a  tool  foe  comparison  of 
such  modalities  based  on  values  that  reflect  patient 
qualicy-of-life  considerations. 

We  developed  a  method  to  investigate,  in  terms  of 
early  cost  and  delayed  benefit,  a  creatmcnt  program  char 
is  known  to  yield  a  large  overall  survival  and  relapse-free 
survival  Improvement  for  a  target  population.  To  illus¬ 
trate  the  method,  we  have  chosen  data  from  all  trials  for 
premenopausal  breast  cancer  patients  studying  treatment 
effects  of  a  CMF  program  and  comparing  it  to  a  concrol 
group  of  no  adjuvant  systemic  therapy.  Each  randomized 
criai  provides  estimates  for  mean  relapse-free  survival  time 
(RFS)  and  mean  overall  survival  time  (OS)  for  created 
and  control  groups.  These  estimates  arc  used  to  obtain 
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die  qualicy-of-life  mcta-analysis  based  on  fitting  multiple 
multivariate  regression  models  for  RFS  and  OS  as  func¬ 
tions  of  follow-up  time.  Partitioning  che  OS  into  health 
stac®  of  TOX,  TWIST,  and  REL,  and  weighting  thee 
time  periods  in  proportion  co  their  consequences  on 
quality  of  life,  facilitates  creacmenr  comparisons  chat 
highlight  the  value  judgments  chat  should  influence 
treatment  choice. 

The  findings  of  this  comparison  demonstrate  chat 
within  10  years,  almost  l  year  of  overall  survival  and 
l  ,5  years  of  relapse- free  survival  can  be  gained  by  creat¬ 
ed  patients  compared  with  controls  (Table  4).  These 
benefits  arc  sufficiently  large  in  terms  of  average  num¬ 
ber  of  months  gained  for  che  treated  patients  to  justify 
che  use  of  treatment  in  many  cases  even  when  subtract¬ 
ing  time  with  early  subjective  toxicity  experienced  by 
the  entire  population. 

The  results  for  che  current  analysis  were  primarily 
obtained  for  patients  with  node-positive  disease.  In 
fact,  the  10-year  estimates  for  relapse- free  and  overall 
survival  for  the  studied  controls  were  33%  and  43%. 
respectively.  Although  che  relative  treatment  effects  of 
CMF  are  likely  to  be  similar  for  patients  with  node¬ 
positive  and  node-negative  disease  (a  46%  reduction  in 
the  odds  of  relapse  and  a  39%  reduction  in  che  odds  of 
death),  the  magnitude  of  benefit  from  CMF  in  terms 
of  the  average  number  of  quaJicy-adj listed  monchs 
gained  is  likely  co  be  much  smaller  for  patients  with  a 
lower  risk  of  relapse.  For  example,  the  current  analysis 
indicated  that  within  10  years  of  follow-up  time,  a 
treatment  chat  reduced  the  odds  of  relapse  by  46% 
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Figure  4  Q-TY/iST  gain  function.  The  months  of  Q-TWiST  gained  tor  the 
chemotherapy  group  is  plotted  according  to  the  fdJow-up  duration.  The 
shaded  region  indicates  the  range  of  months  gained  as  the  utility  coeffl- 
dents  yy-Qx  and  vary  between  zero  and  one.  The  solid  line  wrtnin  the 
shaded  region  corresponds  to  Q-TWiST  with  ur ox  55  ^R£l  *  0-5. 
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provided  an  average  of  18  months  more  relapse-free 
survival  time  for  a  patient  cohort  with  a  33%  1 0-year 
relapse- free  survival.  If  che  same  treatment  effect  were 
achieved  for  a  patient  cohort  with  a  70%  10-yeaf 
relapse-free  survival,  the  average  number  of  relapse-frcc 
time  gained  would  be  approximately  6  months.  In  this 
case,  the  average  benefit  might  be  too  small  to  balance 
the  mi  dal  burden  of  subjective  toxic  effects  of  treatment 
defined  by  the  patients  judgment  concerning  the  cost 
(or  disutility)  of  6  months  of  adjuvant  CMF  therapy. 

For  chis  analysis,  the  utility  coefficients  were  cho¬ 
sen  arbitrarily  because  no  patient-derived  information 
was  available  to  indicate  the  ‘'worth”  of  life  with  toxic 
effects  of  treatment  or  with  relapse.  Values  of  0,  L,  and 
0,5  were  used  to  illustrate  treatment  comparisons  for 
different  end-points  and  threshold  utility  analyses  were 
done  to  determine  how  the  coefficient  values  influ¬ 
enced  the  results.  Thresholds  were  values  of  i^cox  and 
^rel  where  the  groups  had  equal  Q-TWIST.  In  fucurt 
studies,  standard  methods11***  can.  be  used  to  obtain 
utility  values  that  specifically  reflect  patients’  percep¬ 
tions  of  their  quality  of  life.  Such  a  study  has  been  per¬ 
formed  using  a  time  trade-off  method  to  obtain 
patient  preferences  from  104  women  who  had  received 
adjuvant  CMF  treatment.1**15  Padencs  were  presented 
with  hypothetical  scenarios  of  the  general  form; 
'‘Suppose  chat  without  treatment  you  would  live  5 
years.  Based  on  your  experience  of  chemotherapy,  what 
period  of  survival  would  make  6  months  of  initial 
ereatment  worthwhile?”  Seventy-seven  percent  of  the 
patients  would  accept  the  chemotherapy  for  as  little  as 
12  additional  months  of  survival  time  (6  years  total), 
and  89  percent  would  accept  it  for  an  additional  24 
months  of  survival.  Thus,  the  utility  associated  with 
TOX  (*tox)  might  be  greater  than  0.83  (5  years/6 
years)  for  77%  of  the  patients,  and  greater  than  0.71  (5 
yeaxs/7  years)  for  89%  of  the  patient  For  a  utility 
value  of  0.75  for  TOX  and  a  value  of  0.50  for  REL, 
the  current  meta-analysis  indicates  an  average  Q- 
TWiST  gain  of  14  months  for  treated  pariens  within 
10  years  of  follow-up  time 

Perhaps  the  most  important  feature  of  the  Q- 
TWiST  analysis  is  the  accumulation  of  gains  for  the 
treated  patients  over  time  (Fig.  3).  The  toxic  costs  of 
adjuvant  CMF  are  felt  early  after  the  diagnosis  of  breast 
cancer,  Even  if  late  adverse  events  occur,  these  are  not 
frequent  enough  to  detract  from  the  demonstrated  ben¬ 
efit  in  terms  of  delayed  relapse  and  improved  survival 
These  benefits  continue  to  accrue  to  created  patients  as 
long  as  the  relapse- free  survival  and  overall  survival 
curves  for  created  and  control  groups  remain  separated 
Thus,  early  costs  of  adjuvant  CMF  have  been  justified 
by  increasing  long-term  benefits.  The  Q-TWiST 
method  is  useful  for  dlustraring  the  cost  and  benefits  in 
comparisons  between  two  modalities  chat  substantially 
differ  in  terms  of  exposure  to  early  toxic  effects.  For 
example,  it  mighc  be  useful  for  comparing  programs  of 
chemotherapy  versus  endocrine  therapy  versus  their 


combinations  incorporating  patients'  perceptions.  8v 
specifically  including  a  subtraction  of  amounts  of  time 
to  account  for  toxic  costs,  the  Q-TWIST  method  incor¬ 
porates  into  the  treatment  comparison  aspects  of  quality 
of  life  that  are  hidden  in  the  usual  relapse-free  survival 
and  overall  survival  analyses. 
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Summary 

Adjuvant  tamoxifen  for  early  breast  cancer  has  been  shown  to  provide  an 
improvement  in  relapse-free  and  overall  survival,  especially  for  older  women.  The 
purpose  of  this  analysis  was  to  determine  whether  the  benefit  of  adding  chemotherapy 
to  tamoxifen  outweighed  its  costs  in  terms  of  toxic  effects  for  postmenopausal  patients. 
MgthQds:  A  meta-analysis  of  quality-adjusted  survival  was  performed  based  on  data 
from  3920  patients  50  years  of  age  or  older  with  node-positive  breast  cancer 
randomized  in  nine  trials  comparing  combination  chemotherapy  plus  tamoxifen  versus 
tamoxifen  alone.  The  nine  trials  were  included  in  the  worldwide  overview  conducted 
by  the  Early  Breast  Cancer  Trialists’  Collaborative  Group.  The  Q-TWiST  method. 
Quality-adjusted  Time  Without  Symptoms  of  disease  and  Toxicity  of  treatment,  was  used 
to  provide  treatment  comparisons  incorporating  differences  in  quality  of  life  associated 
with  times  patients  spend  with  subjective  toxic  effects,  after  relapse,  and  without 
symptoms  of  relapse  or  toxicity. 

Within  seven  years  of  follow-up  the  modest  benefit  of  increased  relapse-free 
and  overall  survival  for  patients  who  received  chemotherapy  just  balanced  the  costs  in 
terms  of  acute  toxic  side  effects.  Chemotherapy-treated  patients  gained  an  average  of 
5.4  months  of  relapse-free  survival  and  2  months  of  overall  survival  (neither  statistically 
significant),  but  had  to  receive  cytotoxic  treatment  for  2  to  24  months  to  achieve  these 
gains.  There  were  no  values  of  utility  weights  for  time  spent  undergoing  chemotherapy 
and  time  after  relapse  for  which  the  chemotherapy  plus  tamoxifen  program  produced 
significantly  more  Q-TWiST  than  tamoxifen  alone. 

Conclusions:  Within  seven  years  of  follow-up,  adjuvant  chemoendocrine  therapy  did 
not  provide  more  quality-adjusted  survival  time  compared  with  tamoxifen  alone  for 
women  50  years  of  age  or  older  with  node-positive  breast  cancer.  A  better  selection  and 
administration  of  chemotherapy  regimen,  different  scheduling  of  chemotherapy  and 
tamoxifen,  and  appropriate  use  of  patient  and  tumor  characteristics  might  increase  the 
therapeutic  advantage  for  the  combination.  (Word  count  =  320) 
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Introduction 

Adjuvant  tamoxifen  has  been  shown  to  increase  relapse-free  survival  and  overall 
survival  for  patients  with  resectable  breast  cancer,  especially  for  women  50  years  of  age 
or  more.1  For  this  age  group  the  effect  of  combination  chemotherapy  appeared  to  be 
less  than  that  of  tamoxifen  when  indirect  comparisons  were  made  using  the  Early  Breast 
Cancer  Trialists  Collaborative  Group  (EBCTCG)  overview  data.  In  fact,  the  estimated 
typical  reductions  in  the  annual  odds  of  relapse  or  prior  death  (±  s.d.)  were  22  percent 
(±  4)  for  combination  chemotherapy  versus  no  adjuvant  systemic  therapy,  and  30 
percent  (±  2)  for  tamoxifen  versus  no  adjuvant  systemic  therapy.  The  corresponding 
estimated  typical  reductions  in  the  annual  odds  of  death  from  any  cause  (±  s.d.)  were  14 
percent  (±  5),  and  19  percent  (±  3),  respectively.  [Note  that  a  reduction  in  the  annual 
odds  of  15  percent  translates  into  approximately  2  to  6  deaths  avoided  per  100  patients 
treated  depending  on  baseline  risk  of  death.1] 

The  many  physicians  who  use  indirect  comparisons  in  order  to  select  treatment 
for  patients  condemn  chemotherapy  due  to  quality-of-life  considerations  relating  to  its 
early  adverse  side  effects.  For  these  physicians  endocrine  therapies  also  reduce  relapse 
and  death  and  therefore  represent  preferred  therapeutic  options.  In  fact,  tamoxifen  is 
now  prescribed  as  adjuvant  therapy  for  virtually  all  postmenopausal  women  with 
operable  breast  cancer. 

Several  studies  have  been  conducted  to  test  the  comparison  between 
combination  chemotherapy  and  tamoxifen,  to  determine  which  one  is  "the  best"  for 
postmenopausal  women.2-3  Some  of  these  trials  indicated  that  chemotherapy  produced 
superior  results  for  subgroups  of  patients  with  estrogen  receptor  negative  tumors,  while 
tamoxifen  was  superior  for  patients  with  estrogen  receptor  positive  tumors.  Although 
the  competition  between  modalities  has  some  interest,  a  more  worthwhile  question  is 
whether  the  addition  of  chemotherapy  to  tamoxifen  could  improve  outcome  compared 
with  tamoxifen  alone.  Based  on  data  from  3920  women  50  years  of  age  or  older,  the 
EBCTCG  overview  showed  a  reduction  in  annual  odds  of  recurrence  or  death  of 
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26%(±5)  and  a  reduction  in  annual  odds  of  death  of  10%(±7)  from  the  addition  of 
combination  chemotherapy  to  tamoxifen.  Thus,  chemotherapy  provided  a  statistically 
significant  advantage  in  relapse-free  survival,  but  the  effect  on  overall  survival  was  not 
statistically  significant.  The  question  of  whether  the  observed  benefit  for  chemotherapy 
outweighs  the  costs  in  terms  of  toxic  effects  requires  an  answer  before  the  regimen 
should  be  used  for  all  postmenopausal  patients  who  require  adjuvant  systemic  therapy. 

Our  evaluation  of  chemotherapy  effectiveness  in  postmenopausal  patients  was 
based  on  a  meta-analysis  of  quality-adjusted  survival.  We  analyzed  data  from  all  trials 
evaluating  combination  chemotherapy  plus  tamoxifen  versus  tamoxifen  alone  included 
m  the  EBCTCG  overview  update.  Treatment  effects  were  estimated  exclusively  for 
patients  50  years  of  age  or  older.  We  provided  an  additional  type  of  analysis  that 
incorporated  aspects  of  quality  of  life  into  the  treatment  comparison. 

Subjects  and  methods 

All  data  were  obtained  from  the  Early  Breast  Cancer  Trialists’  Cooperative  Group 
(EBCTCG)  secretariat  in  collaboration  with  the  individual  trialists.  The  EBCTCG 
records  were  used  to  identify  all  randomized  clinical  trials  that  were  included  in  the 
EBCTCG  overview  update,1  and  which  compared  combination  chemotherapy  plus 
tamoxifen  versus  tamoxifen  in  women  50  years  old  or  older.  From  the  identified  trials, 
we  obtained  patient-level  data  for  all  patients  meeting  the  eligibility  criteria  of  the 
EBCTCG  overview.  The  data  from  each  patient  included  the  following  variables: 
treatment,  time  to  relapse,  and  time  to  death  or  censoring.  The  data  collection  and 
quality  control  checks  are  described  in  the  publication  of  the  overview  results. 

The  Quality-adjusted  Time  Without  Symptoms  and  Toxicity  (Q-TWiSTi 
method4*5  6  was  used  to  analyze  each  trial  individually.  The  individual  Q-TWiST  results 
were  then  combined  using  a  meta-analysis  methodology7  in  order  to  produce  overall 
summary  results.  The  Q-TWiST  methodology  used  in  this  paper  to  analyze  the 
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individual  trials  has  been  previously  described4-6  and  used  to  evaluate  treatments  for 
breast  cancer.8’9  A  brief  overview  of  the  three  steps  involved  is  given  below. 

Step  1.  A  series  of  clinical  end  points  were  defined  which  corresponded  to 
transitions  between  states  of  health  during  the  course  of  follow-up  for  individual 
patients.  TOX  was  defined  as  the  time  from  randomization  until  the  end  of  treatment 
toxicity,  any  relapse  or  death,  whichever  occurred  first;  RFS  was  defined  as  the  time  to 
any  relapse  or  death,  whichever  occurred  first;  and  OS  was  defined  as  the  time  to  death 
from  any  cause.  The  clinical  health  states  corresponding  to  these  end  points  were;  (i) 
time  spent  with  subjective  toxic  effects  of  treatment  (TOX);  (ii)  time  without  symptoms 
of  disease  relapse  or  toxicity  of  treatment  (TWiST  =  RFS  -  TOX)  and  (iii)  time  following 
disease  relapse  (REL  =  OS  -  RFS). 

Step  2:  The  clinical  trial  data  were  used  to  estimate  the  mean  duration  of  each 
health  state  according  to  treatment  group.  For  the  health  state  TOX,  individual  patient 
level  data  on  the  duration  of  toxicity  were  not  available.  As  a  surrogate,  we  used  6 
months  as  the  mean  TOX  duration  for  the  chemoendocrine  therapy  arm  of  each  trial. 
Although  some  trials  tested  longer  durations  of  chemotherapy,  6  months  is  today's 
standard  duration,  and  it  has  been  shown  to  be  equivalent  to  longer  durations.10  For  the 
duration  of  tamoxifen  use  in  either  arm,  no  toxicity  was  assumed  (i.e.,  TOX  =  0)  because 
whatever  tamoxifen-related  toxicity  occurred  was  assumed  to  be  present  in  both 
treatment  groups.  For  the  end  points  RFS  and  OS,  the  Kaplan-Meier  product  limit 
method11  was  used  to  estimate  the  respective  transitional  survival  curves  according  to 
treatment  group.  The  areas  between  these  curves,  restricted  to  the  median  follow-up 
duration  of  the  trial,  represented  the  estimated  mean  duration  of  each  of  the  clinical 
health  states  (see  Figure  2). 

Step  3:  Utility  coefficients  were  introduced  to  reflect  each  health  state's  quality- 
of-life  value  relative  to  time  in  TWiST.  The  utility  coefficient  scales  range  from  0  to  1 . 
where  0  represents  a  state  as  bad  as  death,  1  represents  a  state  as  good  as  TWiST.  anJ 
values  between  0  and  1  represent  degrees  between  these  extremes.  Mean  qualitv- 
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adjusted  survival  (Q-TWiST)  for  each  treatment  arm  was  then  calculated  from  the  mean 
clinical  health  state  durations  as  follows: 

Q-TWiST  =  utox  x  TOX  +  TWiST  +  urel  x  REL 

where  TOX,  TWiST  and  REL  represent  the  mean  health  state  durations,  and  uTOx  and 
urel  denote  the  utility  coefficients  for  the  states  TOX  and  REL,  respectively.  Note  that 

for  uTOx=urel=1,  Q-TWiST  equals  mean  OS,  and  for  uTOX=l,  urel=0,  Q-TWiST  equals 
mean  RFS. 

Q-TWiST  treatment  comparisons  were  made  by  subtracting  the  estimated  mean 
for  the  tamoxifen  group  from  the  estimated  mean  for  the  chemoendocrine  therapy  group. 
Variance  estimates  for  the  health  state  durations  and  Q-TWiST  were  also  obtained.  The 
utility  coefficients  used  in  this  analysis  were  not  estimated  from  patient-derived  data,  nor 
were  they  assumed  to  be  any  particular  set  of  values.  Instead,  the  final  results  are 
displayed  as  a  sensitivity  analysis  over  the  full  range  of  utility  coefficient  values 
between  0  and  1.  This  is  called  a  threshold  utility  analysis  (see  Figure  3).5 

Once  these  three  steps  were  performed  for  each  of  the  individual  trials,  the  results 
were  combined  in  a  meta-analysis  to  provide  overall  estimates  of  quality-adjusted 
survival.  The  technical  details  of  the  meta-analysis  methodology  are  summarized  in  the 
appendix  and  are  reported  in  detail  elsewhere.7  Briefly,  the  individual  trial  results  were 
combined  using  regression  models.  The  dependent  variables  were  mean  RFS  and  mean 
OS,  and  the  independent  variable  was  median  follow-up  duration.  This  allowed  the 
meta- analysis  to  accommodate  the  varying  median  follow-up  intervals  among  the  trials. 
The  regression  parameters  were  estimated  by  generalized  least  squares12  in  order  to 
weight  the  trials  according  to  their  respective  variance  estimates.  Separate  regression 
models  were  estimated  for  each  treatment  group.  The  estimated  regression  models  were 
then  used  to  predict  the  mean  clinical  health  state  durations  for  the  follow-up  duration 
of  84  months  (7  years).  Covariation  among  these  estimates  was  also  derived  from  the 
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regression  model.  The  results  were  substituted  into  the  above  equation  for  Q-TWiST, 
and  the  Q-TWiST  treatment  difference  was  determined  for  all  possible  values  of  the 
unknown  utility  coefficients  in  a  threshold  utility  analysis. 

The  threshold  utility  analysis  consisted  of  determining  all  pairs  of  utility 
coefficient  values  for  which  the  two  treatments  had  equal  Q-TWiST  (i.e.,  the  treatment 
difference  was  zero).  This  provided  a  threshold  line  which  separated  the  range  of 
possible  utility  coefficient  pairs  into  two  regions.  These  regions  corresponded  to  pairs  of 
utility  values  for  which  the  chemoendocrine  therapy  group  provided  more  Q-TWiST 
than  the  tamoxifen  group  and  vice  versa  (see  Figure  3).  Ninety-five  percent  confidence 
limits  for  the  threshold  line  were  also  computed. 

Results 

Chemoendocrine  therapy  with  multiagent  cytotoxics  and  tamoxifen  was  compared  with 
tamoxifen  alone  in  women  50  years  of  age  or  older  within  the  framework  of  nine  clinical 
trials  included  in  the  1990  update  of  the  EBCTCG  database.  Table  1  describes  the 
treatment  comparison  and  patient  population  for  each  trial2-13-  14.15.i6.17.i8.19.20.21  an(j 
Table  2  gives  the  number  of  patients  randomized  to  each  treatment  group  as  well  as  the 
number  of  relapses  and  deaths  on  each  treatment  arm.  Relapse-free  survival  and  overall 
survival  are  shown  in  Figure  1  for  the  entire  population  of  3920  randomized  patients. 

Table  3  shows  the  results  of  the  individual  Q-TWiST  treatment  comparisons 
performed  on  each  clinical  trial.  The  treatment  effect  (i.e.,  the  mean  for  the 
chemoendocrine  therapy  group  minus  the  mean  for  the  tamoxifen  group)  is  shown  for 
each  of  the  components  of  Q-TWiST:  RFS,  OS,  TWiST  and  REL  as  well  as  for  Q-TWiST 
with  the  arbitrary  utility  values  of  ujox  =  UREL  =  0-5.  These  utility  values  were  selected 
to  illustrate  the  range  of  Q-TWiST  results  across  the  trials  and  do  not  represent  patient- 
derived  estimates.  Using  these  values,  the  Q-TWiST  treatment  effects  for 
chemoendocrine  therapy  compared  with  tamoxifen  ranged  from  -2  months  to  +7 
months.  These  results  describe  the  mean  amount  of  time  gained  for  the  chemoendocnne 
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therapy  group,  up  to  a  maximum  determined  by  the  median  follow-up  duration,  for  each 
of  the  Q-TWiST  components.  The  median  follow-up  duration  for  each  clinical  trial  is  also 
shown  in  Table  3.  These  ranged  from  24  months  to  108  months  of  follow-up. 

Table  4  presents  the  estimated  means  for  the  components  of  Q-TWiST 
corresponding  to  a  median  follow-up  duration  of  84  months  based  on  the  meta-analysis. 
The  treatment  effect  (chemoendocrine  therapy  group  minus  tamoxifen  group)  is  also 
given  for  each  component  as  well  as  Q-TWiST  with  the  arbitrary  utility  coefficient 
values  of  uTOx  =  urel  =  0.5. 

Based  on  these  results,  the  chemoendocrine  therapy  provides  more  time  in  the 
clinical  health  state  TOX,  but  less  time  in  REL.  This  is  due  to  the  larger  effect  that 
chemotherapy  has  on  RFS  than  on  OS.  The  amount  of  time  spent  in  TWiST  is  essentially 
identical  for  the  two  treatment  groups.  This  is  based  on  the  results  restricted  to  7  years 
of  follow-up  and  is  influenced  by  our  selection  of  6  months  for  the  duration  of  TOX 
associated  with  the  chemoendocrine  therapy. 

Subgroup  analyses  were  also  performed  for  two  cohorts  defined  by  estrogen 
receptor  content  of  the  primary  tumor;  932  patients  with  less  than  50  fmol/mg  cytosol 
protein  and  1898  patients  with  50  fmol/mg  cytosol  protein  or  more.  Within  84  months 
of  follow-up,  the  estimated  mean  Q-TWiST  gained  for  chemoendocrine  therapy 
compared  with  tamoxifen  alone  (with  uTox  =  urel  =  0.5)  and  95%  confidence  intervals 
were  3.4  months  (-2.5  to  9.2)  and  -6.6  months  (-12.9  to  -0.2),  respectively. 

Figure  3  displays  the  threshold  utility  analyses  based  on  the  meta-analysis  for 
follow-up  duration  of  84  months.  The  solid  line  indicates  pairs  of  utility  coefficient 
values  for  which  the  two  treatments  have  equal  Q-TWiST.  For  pairs  which  lie  below  this 
threshold  line,  the  chemoendocrine  therapy  provided  less  Q-TWiST  than  tamoxifen. 
Conversely,  for  pairs  above  the  threshold  line,  the  chemoendocrine  therapy  provided 
more  Q-TWiST  than  tamoxifen.  In  particular,  chemoendocrine  therapy  provided  more  Q- 
TWiST  for  patients  who  value  time  following  relapse  lower  than  they  value  time  spent 
with  toxic  effects  of  adjuvant  chemotherapy.  For  example,  patients  who  place  a  f a i r  1  v 
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high  value  on  time  with  treatment  toxicity  (uTox  =  0.8)  and  a  lower  value  on  time  with 
disease  relapse  (ureL  =  0.6)  can  expect  a  benefit  from  chemoendocrine  therapy  in  terms 
of  quality- adjusted  survival.  The  threshold  utility  plot  also  allows  threshold  lines  to  be 
drawn  to  indicate  the  95  percent  confidence  intervals  for  the  utility  coefficients  that 
provide  statistically  significant  differences  in  Q-TWiST.  These  are  usually  displayed  as 
dashed  lines  on  the  figure. The  fact  that  no  such  lines  appear  on  Figure  3  indicates 
that  the  Q-TWiST  differences  are  not  statistically  significant  for  any  pair  of  utility 
coefficients. 

The  Q-TWiST  gain  function  illustrates  the  predicted  months  gained  for  the 
chemoendocrine  therapy  group  according  to  follow-up  duration  (Figure  4).  The  shaded 
region  represents  the  range  of  Q-TWiST  differences  calculated  for  all  pairs  of  possible 
utility  coefficients,  and  the  dark  line  within  the  shaded  region  corresponds  to  Q-TWiST 
with  utox  =  urel  =  0.5.  Initially,  the  gain  in  Q-TWiST  for  the  chemoendocrine  therapy 
group  is  negative  because  of  the  toxicity  experienced  early  in  follow-up.  As  follow-up 
time  increases,  the  gains  for  the  chemoendocrine  therapy  group  associated  with  delayed 
relapse  and  improved  survival  become  apparent.  These  gains  are  modest  and  not 
statistically  significant. 

Discussion 

Chemoendocrine  therapy  consisting  of  cytotoxic  agents  combined  with  tamoxifen  was 
always  hypothesized  to  provide  an  additive  effect  of  the  two  modalities.  In  the  Early 
Breast  Cancer  Trialists  Cooperative  Group  (EBCTCG)  overview  update  in  1990, 
prolonged  cytotoxic  chemotherapy  added  to  tamoxifen  was  shown  to  provide 
statistically  significant  reduction  in  the  annual  odds  of  recurrence  or  death  compared 
with  tamoxifen  alone  for  women  50  years  of  age  or  older.  The  benefit  in  terms  of  overall 
survival  was  not  statistically  significant.  Because  tamoxifen  alone  provides  an  overall 
survival  advantage  for  these  patients,  this  adjuvant  treatment,  which  is  associated  with 
only  minimal  toxic  side  effects,  has  become  the  standard.  If  cytotoxic  chemotherapv 
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also  had  virtually  no  toxic  side  effects,  the  benefits  with  respect  to  relapse-free  survival 
available  today  might  be  sufficient  to  justify  the  routine  addition  of  this  modality  to 
tamoxifen.  Cytotoxic  chemotherapy,  however,  is  associated  with  unpleasant  adverse 
side  effects  against  which  the  benefits  of  using  it  in  conjunction  with  tamoxifen  must  be 
weighed.  It  is,  therefore,  important  to  provide  a  tool  for  comparison  of  treatment 
regimens  based  on  values  reflecting  patient  quality-of-life  considerations. 

We  developed  a  method,  Q-TWiST,  to  investigate,  in  terms  of  early  cost  and 
delayed  benefit,  a  treatment  program  which  is  known  to  yield  a  relapse-free  survival 
improvement  for  a  target  population.  We  applied  the  method  to  data  from  all 
randomized  clinical  trials  for  postmenopausal  breast  cancer  patients  studying  treatment 
effects  of  chemoendocrine  therapies  using  different  types  of  cytotoxic  agents  combined 
with  tamoxifen  and  compared  with  tamoxifen  alone  for  the  same  duration.  Each  trial 
provided  estimates  for  mean  relapse-free  survival  time  (RFS)  and  mean  overall  survival 
time  (OS)  for  treated  and  control  groups.  These  estimates  were  used  to  obtain  the 
quality-of-life  meta-analysis  based  on  fitting  multiple  multivariate  regression  models  for 
RFS  and  OS  as  functions  of  follow-up  time.  Partitioning  the  OS  into  health  states  of 
TOX,  TWiST  and  REL,  and  weighting  these  time  periods  in  proportion  to  their 
consequences  on  quality  of  life  facilitate  treatment  comparisons  which  highlight  the 
value  judgements  that  influence  treatment  choice. 

The  findings  of  this  comparison  demonstrate  that  within  seven  years,  the 
improvement  in  relapse-free  survival  is  counter- balanced  by  a  period  of  cytotoxic 
treatment  duration  set  at  six  months.  While  quality-adjusted  survival  analysis  favored 
chemoendocrine  therapy  for  patients  who  place  a  low  value  on  time  after  relapse  and  are 
not  averse  to  experiencing  the  toxic  effects  of  chemotherapy,  the  gain  in  Q-TWiST  was 
not  statistically  significant  for  any  pair  of  utility  coefficients. 

For  this  analysis,  the  utility  coefficients  were  chosen  arbitrarily  because  no 
patient-derived  information  was  available  to  indicate  the“worth”  of  life  with  toxic 
effects  of  treatment  or  with  relapse.  Values  of  0,  1,  and  0.5  were  used  to  illustrate 
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treatment  comparisons  for  different  endpoints  and  threshold  utility  analyses  were  done 
to  determine  how  the  coefficient  values  influenced  the  results.  Thresholds  were  values 
of  utox  and  uREL  where  the  groups  had  equal  Q-TWiST.  In  future  studies,  standard 
methods22-23  can  be  used  to  obtain  utility  values  which  specifically  reflect  patients' 
perceptions  of  their  quality  of  life.  Such  a  study  has  been  performed  using  a  time  trade¬ 
off  method  to  obtain  patient  preferences  from  104  women  who  had  received  adjuvant 
CMF  treatment.24'25-26  Patients  were  presented  with  hypothetical  scenarios  of  the 
general  form:  “Suppose  that  without  treatment  you  would  live  5  years.  Based  on  your 
experience  of  chemotherapy,  what  period  of  survival  would  make  six  months  of  initial 
treatment  worthwhile?”  Seventy-seven  percent  of  the  patients  would  accept  the 
chemotherapy  for  as  little  as  12  additional  months  of  survival  time,  and  89  percent  would 
accept  it  for  an  additional  24  months  of  survival.  Thus,  the  utility  associated  with  TOX 
(utox)  might  be  greater  than  0.83  (5  years/6  years)  for  77  percent  of  the  patients,  and 
greater  than  0.71  (5  years/7  years)  for  89  percent  of  the  patients.  Based  on  these 
findings,  for  a  utility  value  of  0.75  for  TOX  and  a  value  of  0.50  for  RJEL,  the  current 
meta-analysis  indicates  an  average  Q-TWiST  gain  of  2.2  months  for  chemoendocrine 
treated  patients  within  seven  years  of  follow-up  (95%  confidence  interval,  -4.5  to  8.9 
months). 

The  Q-TWiST  analysis  takes  into  account  the  overall  benefits  and  costs  of  the 
combined  modality  and  the  endocrine  therapy  alone  as  expressed  by  the  partitioning 
(Figure  2).  The  administration  of  all  cytotoxic  regimens  was  associated  with  a  relevant 
subjective  toxicity  which  was  represented  in  our  calculations  by  the  initial  costs  (TOX). 
The  subjective  and  objective  costs  as  well  as  the  efficacy  of  the  cytotoxic  component  of 
the  chemoendocrine  regimens  are  heterogeneous  across  trials  and  in  some  of  the  clinical 
trials  the  cytotoxic  doses  administered  were  suboptimal.27’28  Lower  doses  ot 
chemotherapy  still  represent  a  cost  in  terms  of  subjective  toxicity  but  are  associated  with 
significantly  lower  efficacy.  Thus,  the  Q-TWiST  analysis  indicates  that  in  order  to  be 
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efficient  we  must  limit  the  period  of  TOX  to  the  minimum  while  maintaining  efficacy  with 
full-dose  chemotherapy. 

The  chemotherapy  regimens  were  also  different  in  terms  of  duration.  In  fact, 
cytotoxic  regimens  were  given  for  durations  which  varied  between  63  days  and  24 
months.  We  did  not  take  into  account  such  heterogeneity  in  duration  of  treatment 
because  "standard"  cytotoxic  chemotherapies  today  indicate  for  postmenopausal 
patients  a  proper  treatment  duration  to  be  of  3  to  6  monthly  courses.10,29  Based  on  this 
analysis,  the  additional  toxicity  provided  by  the  prolonged  chemotherapy  (CMFVP  or 
the  melphalan  regimens)  would  do  more  harm  than  good.  The  longer  durations  of 
chemotherapy  also  increase  the  opportunity  for  a  negative  drug  interaction  between 
cytotoxic  agents  and  tamoxifen.  Such  interaction  has  been  postulated  from  data  in 
vivo 30  and  in  vitro .31 

In  this  analysis,  all  patients  in  the  control  groups  received  endocrine  therapy  with 
tamoxifen  alone  or  combined  with  low-dose  prednisone  for  durations  of  one  year  to  five 
years.  This  treatment  has  been  shown  to  be  effective  for  postmenopausal  patients, 
especially  for  those  with  elevated  levels  of  estrogen  receptor  content  in  the  primary 
tumor.  Many  of  the  trials  included  in  this  overview  restricted  enrollment  to  patients  with 
estrogen  receptor-positive  tumors  (Table  1).  The  magnitude  of  effectiveness  achieved 
by  the  endocrine  therapy  alone  is  very  high  for  these  patients,  leaving  less  opportunity 
for  chemotherapy  to  further  improve  upon  outcome. 

Individual  trials  which  use  short  duration,  full-dose  chemotherapy  given  prior  to 
initiation  of  tamoxifen  might  identify  an  optimal  chemoendocrine  regimen.  The  use  of 
the  Q-TWiST  method  on  overview  data  could  quantify  net  patient  benefit  even  before 
overall  survival  differences  become  apparent.  Chemoendocrine  therapy  combinations 
remain  investigational  for  postmenopausal  women,  especially  for  patients  selected  by 
disease  and  patient  characteristics  which  predict  a  high  level  of  response  to  endocrine 
therapies  alone. 

(Word  count  =  3378) 
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Table  1.  Trials  in  the  Q-TWiST  Meta-Analysis  Comparing  Chemoendocrine  Therapy 
versus  Endocrine  Therapy  Alone  for  Postmenopausal  Patients 


Trial  Name 

Treatment  Comparison* 

Patient  Population 

Ludwig  III  4  13  14 

12CMF  +  12  pT  vs.  12  pT 

N+,  all  ER 

N  Sweden  BCG  « 

8  AC  T24  vs.  24  T 

N+,  all  ER 

Case  Western  B  16 

12CMFVPT36  vs.  36  T 

N+,  ER+ 

Vienna  Gyn. 17 

6CMFT12  vs.  12  T 

N+,  all  ER 

SWOG  is 

12CMFVPT12  vs.  12  T 

N+,  ER+ 

U.K.  Asia  19 

24CMFT24  vs.  24  T 

N+,  all  ER 

GROCTA  I  Italy  2 

6  ->  4  CMF  ->  Epidox  T60  vs.  60  T 

N+,  ER+ 

Danish  BCG  20 

8CMFT12  vs.  12  T 

N+,  all  ER 

NSABP  B16  2i 

4ACT60  vs.  60  T 

N+,  ER+** 

17  PF*  T60  vs.  60  T 

17PAF*  T60  vs.  60  T 

+  Numbers  refer  to  number  of  cycles  of  chemotherapy  and  number  of  months  of 
tamoxifen,  respectively. 

*  From  1984  to  1985,  chemotherapy  included  melphalan  and  5-fluorouracil;  from  1985 
to  1988,  chemotherapy  included  melphalan,  5-fluorouracil  and  adriamycin. 

ER+  if  <  60  years  old;  any  ER  if  >  60  years  old. 
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Table  2.  Sample  Sizes,  Relapses  and  Deaths  for  the  Trials  in  the  Q-TWiST  Meta- Analysis. 

Number  of  Number  of  Number  of 

Brents  Relapses/Deaths  Deaths 


Trial 

CT  +  Tam 

Tam 

CT+  Tam 

Tam 

CT  +  Tam 

Tam 

Ludwig  III 

165 

158 

91 

105 

74 

87 

N  Sweden  BCG 

35 

37 

19 

24 

16 

18 

Case  Western  B 

44 

47 

14 

22 

11 

19 

Vienna  Gyn. 

30 

29 

16 

11 

12 

10 

SWOG  7827 

301 

292 

94 

97 

78 

67 

UK/Asia  Collab. 

46 

67 

23 

26 

19 

19 

GROCTA I  Italy 

106 

104 

21 

25 

10 

11 

Danish  BCG 

602 

631 

193 

251 

142 

158 

NSABPB16 

817 

409 

98 

83 

47 

35 

Total 

2.146 

1.774 

569 

644 

409 

424 

CT  +  Tam  =  chemoendocrine  therapy  (cytotoxic  chemotherapy  +  tamoxifen) 
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Table  3.  Mean  Differences  in  Months  (chemoendocrine  group  minus  tamoxifen  group) 
for  the  Components  of  Q-TWiST  Restricted  to  the  Median  Follow-up  Duration  for  the 

Individual  Trials. 


Treatment  Differences  in  Months 


Median 

follow-up 

(months) 

TOX 

TWiST 

REL 

OS 

RFS 

Q-TWiST 

(uTOX  =  0.5 

Mrel  =  0  5) 

Ludwig  III 

108 

6 

8 

-7 

7 

13 

7 

N  Sweden  BCG 

84 

6 

4 

0 

9 

10 

7 

Case  Western  B 

72 

6 

2 

-5 

3 

8 

3 

Vienna  Gyn. 

72 

6 

-10 

1 

-2 

-4 

-6 

SWOG  7827 

60 

6 

-5 

-2 

-1 

1 

-3 

UK/Asia  Collab. 

60 

6 

-10 

2 

-2 

-4 

-6 

GROCTA  I  Italy 

48 

6 

-4 

-1 

1 

2 

-2 

Danish  BCG 

36 

6 

-4 

-2 

0 

2 

-2 

NSABPB16 

24 

6 

-5 

-1 

0 

1 

-2 
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Table  4.  Overall  Means  (in  months,  restricted  to  7  years)  Based  on  the  Meta- Analysis. 


Treatment  group 


Variable 

CT  +  Tam 

Tam 

Difference 

95%  Cl 

TOX 

6.0 

0.0 

6.0 

TWiST 

54.7 

55.3 

-0.6 

-8.3  to  7.1 

REL 

8.2 

11.6 

-3.4 

-7.9  to  1.1 

OS 

68.9 

66.9 

2.0 

-3.2  to  7.2 

RFS 

60.7 

55.3 

5.4 

-2.3  to  13.1 

Q-TWiST 

(uTOX  =  0.5, 

UREL  =  0.5) 

61.8 

61.1 

0.7 

-6.0  to  7.4 
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FIGURE  LEGENDS 

Figure  1.  (A)  Relapse-free  survival  and  (B)  overall  survival  for  the  entire  3920-patient 
sample  according  to  treatment  group  (solid  line,  chemoendocrine  therapy  group; 
dashed  line,  tamoxifen  alone  group).  Seven-year  relapse-free  survial  percents  were 
52%  and  45%,  respectively,  and  seven-year  overall  survival  percents  were  57%  and 
55%,  respectively. 

Figure  2.  Partitioned  survival  curves  for  the  entire,  3920-patient  sample  according  to 
treatment  group:  (A)  tamoxifen  alone  and  (B)  chemoendocrine  therapy.  Areas 
between  the  curves  correspond  to  the  mean  clinical  health-state  durations  within 
the  follow-up  interval.  TOX  corresponds  to  time  spent  with  adverse  side  effects  due 
to  chemotherapy;  TWiST  denotes  time  spent  without  symptoms  of  relapse  and 
toxicity  of  treatment;  REL  denotes  the  time  following  disease  relapse. 

Figure  3.  Threshold  utility  plot  for  84  months  of  follow-up.  The  solid  line  indicates  pairs 
of  utility  coefficient  values  for  which  the  two  treatments  have  equal  Q-TWiST 
Chemoendocrine  therapy  provides  more  Q-TWiST  than  tamoxifen  alone  for  pairs  of 
utility  coefficients  above  the  line,  and  less  Q-TWiST  for  coefficients  below  the  line. 
(N.S.  denotes  not  significant.) 

Figure  4.  Q-TWiST  gain  function.  The  months  of  Q-TWiST  gained  for  the 
chemoendocrine  therapy  group  compared  with  tamoxifen  alone  is  plotted  according 
to  the  follow-up  duration.  The  shaded  region  indicates  the  range  of  months  gained 
as  the  utility  coefficients  (utox  and  urel)  vary  between  zero  and  one.  The  solid 
line  within  the  shaded  region  corresponds  to  Q-TWiST  with  utox  =  urel  =  0.5. 


22 


•  • 


Figure  3 


84  Months 


2 


Months  Gained  for  Chemotherapy 


Figure  4 


25 


- 1 - - - - - - r 

30  60  90  1 20 

Follow-up  Duration  in  Months 


28 


n  "fti 


i  *  *  * 


appendix 

In  this  appendix  we  describe  briefly  the  computational  methods  used  in  the  Q-TWiST 
meta-analysis  (see  Reference  7  for  more  details).  Individual  Q-TWiST  analyses  were  first 

carried  out  on  each  clinical  trial.  These  results  were  combined  using  the  following  regression 
models: 

RFS  =  3\M  +  j32M2 
OS  =  exM  +  92M\ 

where  RFS  and  OS  denote  respectively  the  mean  relapse-free  survival  time  and  the  mean 
overall  survival  time,  and  M  denotes  the  median  follow-up  duration  (in  months)  for  the 
clinical  trial.  The  unknown  regression  parameters  are  denoted  by  /3X ,j32  and  6U92. 

To  perform  the  meta-analysis,  we  used  the  RFS  and  OS  results  (restricted  to  the  me¬ 
dian  follow-up  duration)  for  each  clinical  trial  as  data  for  estimating  the  regression  models. 
The  regression  parameters  were  estimated  by  generalized  least  squares  according  to  treat¬ 
ment  group.  This  consisted  of  minimizing  the  total  sum  of  the  weighted  squared  differences 
between  the  observed  data  and  the  means  predicted  by  the  regression  models,  where  the 
weights  were  derived  from  the  inverse  of  the  variation  observed  within  each  of  the  clinical 
trials.  Lsing  these  techniques,  the  following  regression  models  were  estimated: 

CT  +  TAM  TAM 

RFS  =  1.0332M  —  0.00370A/2  RFS  =  0.9929M  -  0.00398A/2 

OS  =  1.0496M  -  0.00273 M2  OS  =  1. 0509 M  -  0.00303 M2 

We  then  substituted  M  =  84  months  into  these  equations  to  obtain  predicted  mean  RFS 
and  OS  based  on  the  meta-analysis  for  each  treatment  group.  For  example,  substituting 

M  —  84  months  in  the  first  equation  for  TAM  gives  RFS  =  55.3,  corresponding  to  the  RFS 

estimate  given  in  Table  4  for  the  TAM  group.  The  remaining  estimates  in  Table  4  were 
obtained  using  the  equations: 

TWiST  =  RFS  -  TOX 
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REL  =  OS  -  RFS 

Q-TWiST  =  UToxTOX  +  TWiST  +  uRELREL 

Treatment  differences  were  obtained  by  subtracting  the  results  for  the  TAM  group  from 
the  results  for  the  CT+TAM  group.  In  particular,  the  mean  treatment  differences  corre¬ 
sponding  to  TOX,  TWiST  and  REL  are  6.0,  -0.6  and  -3.4,  respectively.  Therefore,  the 
amount  of  Q-TWiST  gained  for  the  CT+TAM  group  within  84  months  based  on  the  meta¬ 
analysis  is 

6-Outox  -  0.6  -  3.4urel. 

The  threshold  line  appearing  in  Figure  3  was  obtained  by  setting  this  equation  equal  to  zero 
and  solving  for  the  unknown  utility  coefficients.  This  gives  the  following  equation  for  the 
threshold  line: 

0.6  +  3.4urel 

“TOX  = - M - ' 

This  equation  describes  the  pairs  of  values  of  u-pox  and  urEE  for  which  the  two  treatments 
provide  the  same  amount  of  Q-TWiST. 

The  Q-TWiST  gain  function  shown  in  Figure  4  was  obtained  by  plotting  the  results  as  M 
ranged  from  0  to  120  months.  The  shaded  region  in  the  plot  was  computed  by  determinine 
the  range  of  Q-TWiST  treatment  differences  as  the  utility  coefficients  varied  between  0  and  1 
for  each  value  of  M.  For  example,  when  M  =  84  months,  the  maximum  Q-TWiST  difference 
occurs  when  uTox  =  1.0  and  uREL  =  0.0,  and  the  minimum  occurs  when  uTox  =  0.0  and 
urel  =  1-0.  The  region  between  these  extremes  is  shaded  in  the  figure  as  M  ranges  from  0 
to  120  months.  The  solid  line  within  the  shaded  region  corresponds  to  utox  =  uREL  =  ij  V 
In  this  way,  the  Q-TWiST  gain  function  shows  the  range  of  Q-TWiST  treatment  differences 
over  a  range  of  median  follow-up  durations. 
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